[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:11:54.317318  3211 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.34.254:43721
I20260709 12:11:54.318869  3211 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:11:54.319924  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:54.337757  3218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:54.338020  3220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:54.339874  3211 server_base.cc:1061] running on GCE node
W20260709 12:11:54.338291  3217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:55.584741  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:55.585050  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:55.585282  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599115585262 us; error 0 us; skew 500 ppm
I20260709 12:11:55.586190  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:55.591853  3211 webserver.cc:533] Webserver started at http://127.3.34.254:34321/ using document root <none> and password file <none>
I20260709 12:11:55.592782  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:55.593115  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:55.593609  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:55.599766  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/master-0-root/instance:
uuid: "6eae6bfe4e9840c595b5d74a9556413c"
format_stamp: "Formatted at 2026-07-09 12:11:55 on dist-test-slave-x5d7"
I20260709 12:11:55.607880  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:11:55.613230  3226 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:55.614634  3211 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:11:55.615113  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/master-0-root
uuid: "6eae6bfe4e9840c595b5d74a9556413c"
format_stamp: "Formatted at 2026-07-09 12:11:55 on dist-test-slave-x5d7"
I20260709 12:11:55.615486  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:55.668120  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:55.669867  3211 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:11:55.670372  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:55.750777  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.254:43721
I20260709 12:11:55.750916  3277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.254:43721 every 8 connection(s)
I20260709 12:11:55.759876  3278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:55.784849  3278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: Bootstrap starting.
I20260709 12:11:55.791393  3278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:55.793560  3278 log.cc:826] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: Log is configured to *not* fsync() on all Append() calls
I20260709 12:11:55.798586  3278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: No bootstrap required, opened a new log
I20260709 12:11:55.819658  3278 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER }
I20260709 12:11:55.820241  3278 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:55.820448  3278 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eae6bfe4e9840c595b5d74a9556413c, State: Initialized, Role: FOLLOWER
I20260709 12:11:55.821444  3278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER }
I20260709 12:11:55.821926  3278 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:11:55.822178  3278 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:11:55.822467  3278 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:55.826776  3278 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER }
I20260709 12:11:55.827626  3278 leader_election.cc:304] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6eae6bfe4e9840c595b5d74a9556413c; no voters: 
I20260709 12:11:55.829295  3278 leader_election.cc:290] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:11:55.829733  3281 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:55.832103  3281 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 1 LEADER]: Becoming Leader. State: Replica: 6eae6bfe4e9840c595b5d74a9556413c, State: Running, Role: LEADER
I20260709 12:11:55.833128  3281 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER }
I20260709 12:11:55.834185  3278 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:11:55.845422  3282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6eae6bfe4e9840c595b5d74a9556413c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER } }
I20260709 12:11:55.845629  3283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6eae6bfe4e9840c595b5d74a9556413c. Latest consensus state: current_term: 1 leader_uuid: "6eae6bfe4e9840c595b5d74a9556413c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eae6bfe4e9840c595b5d74a9556413c" member_type: VOTER } }
I20260709 12:11:55.846364  3282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:55.846400  3283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:55.850606  3290 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:11:55.864377  3290 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:11:55.867093  3211 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:11:55.883486  3290 catalog_manager.cc:1383] Generated new cluster ID: 530be549652c4e989f8ae17b34d40ebd
I20260709 12:11:55.883855  3290 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:11:55.928143  3290 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:11:55.930001  3290 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:11:55.956624  3290 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: Generated new TSK 0
I20260709 12:11:55.957660  3290 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:11:55.998977  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:56.009944  3300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:56.011920  3301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.016486  3211 server_base.cc:1061] running on GCE node
W20260709 12:11:56.016814  3303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.017740  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:56.018057  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:56.018249  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599116018229 us; error 0 us; skew 500 ppm
I20260709 12:11:56.018864  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:56.023432  3211 webserver.cc:533] Webserver started at http://127.3.34.193:42619/ using document root <none> and password file <none>
I20260709 12:11:56.024016  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:56.024251  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:56.024560  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:56.026019  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-0-root/instance:
uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.031945  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.008s
I20260709 12:11:56.036686  3308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.037627  3211 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:11:56.037950  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.038234  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:56.064975  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:56.066452  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:56.069343  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:56.074314  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:56.074548  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.074921  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:56.075129  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:11:56.186367  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.193:36495
I20260709 12:11:56.186499  3370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.193:36495 every 8 connection(s)
I20260709 12:11:56.193935  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:56.204813  3375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:56.205967  3376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.212073  3211 server_base.cc:1061] running on GCE node
W20260709 12:11:56.213728  3378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.215013  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:56.215315  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:56.215539  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599116215520 us; error 0 us; skew 500 ppm
I20260709 12:11:56.216358  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:56.219624  3211 webserver.cc:533] Webserver started at http://127.3.34.194:42021/ using document root <none> and password file <none>
I20260709 12:11:56.220310  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:56.220379  3371 heartbeater.cc:344] Connected to a master server at 127.3.34.254:43721
I20260709 12:11:56.220608  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:56.220965  3371 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:56.220979  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:56.222008  3371 heartbeater.cc:507] Master 127.3.34.254:43721 requested a full tablet report, sending...
I20260709 12:11:56.222548  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-1-root/instance:
uuid: "dc99371cc44742118d325bc1e75f2c88"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.225064  3243 ts_manager.cc:194] Registered new tserver with Master: 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495)
I20260709 12:11:56.227465  3243 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43058
I20260709 12:11:56.229923  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:11:56.234448  3383 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.236006  3211 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:11:56.236336  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
uuid: "dc99371cc44742118d325bc1e75f2c88"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.236714  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:56.250936  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:56.252455  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:56.254766  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:56.258114  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:56.258423  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.258739  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:56.258958  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.355389  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.194:43229
I20260709 12:11:56.355741  3445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.194:43229 every 8 connection(s)
I20260709 12:11:56.361822  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:56.370757  3449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:56.372314  3450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.376760  3446 heartbeater.cc:344] Connected to a master server at 127.3.34.254:43721
I20260709 12:11:56.377219  3446 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:56.378278  3446 heartbeater.cc:507] Master 127.3.34.254:43721 requested a full tablet report, sending...
I20260709 12:11:56.380867  3243 ts_manager.cc:194] Registered new tserver with Master: dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:56.382894  3243 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43064
W20260709 12:11:56.383747  3452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:56.386238  3211 server_base.cc:1061] running on GCE node
I20260709 12:11:56.387331  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:56.387531  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:56.387777  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599116387736 us; error 0 us; skew 500 ppm
I20260709 12:11:56.388427  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:56.391619  3211 webserver.cc:533] Webserver started at http://127.3.34.195:33375/ using document root <none> and password file <none>
I20260709 12:11:56.392166  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:56.392391  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:56.392736  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:56.393916  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-2-root/instance:
uuid: "3e41a4247b314aa09d7917b2f2186c32"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.399351  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260709 12:11:56.403580  3457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.404635  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 12:11:56.405035  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
uuid: "3e41a4247b314aa09d7917b2f2186c32"
format_stamp: "Formatted at 2026-07-09 12:11:56 on dist-test-slave-x5d7"
I20260709 12:11:56.405457  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599114140998-3211-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:56.437467  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:56.439291  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:56.442155  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:56.446062  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:56.446365  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.446658  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:56.446866  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:56.548650  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.195:35795
I20260709 12:11:56.549257  3519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.195:35795 every 8 connection(s)
I20260709 12:11:56.569264  3520 heartbeater.cc:344] Connected to a master server at 127.3.34.254:43721
I20260709 12:11:56.569712  3520 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:56.570683  3520 heartbeater.cc:507] Master 127.3.34.254:43721 requested a full tablet report, sending...
I20260709 12:11:56.573243  3243 ts_manager.cc:194] Registered new tserver with Master: 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:56.573787  3211 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016241448s
I20260709 12:11:56.575127  3243 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43066
I20260709 12:11:56.640015  3243 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43072:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:11:56.645179  3243 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:11:56.753789  3485 tablet_service.cc:1511] Processing CreateTablet for tablet db0d9af34f2d452f8fffa06d1f28b163 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:56.757395  3483 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa99770647b414da871053c87e2801d (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:56.757251  3484 tablet_service.cc:1511] Processing CreateTablet for tablet 548d35ecc1bc4cc7acd530b660776d6c (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:56.759999  3482 tablet_service.cc:1511] Processing CreateTablet for tablet 02ad1834656e42719c29e789305c6d59 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:56.760524  3481 tablet_service.cc:1511] Processing CreateTablet for tablet 32f12414843040469cd7c77fa2e70fca (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:56.762290  3480 tablet_service.cc:1511] Processing CreateTablet for tablet 8357544c95e94921a033345960c24b44 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:56.762588  3479 tablet_service.cc:1511] Processing CreateTablet for tablet 26d56bfff00b4f1cb82ea7202333dbde (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:56.764770  3478 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce30e4a66534c948f64b15993ba3ead (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:56.767021  3477 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5b18d134e49d78a2e60d482dc7638 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:56.768296  3335 tablet_service.cc:1511] Processing CreateTablet for tablet 548d35ecc1bc4cc7acd530b660776d6c (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:56.770109  3335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d35ecc1bc4cc7acd530b660776d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.775897  3485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0d9af34f2d452f8fffa06d1f28b163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.775696  3336 tablet_service.cc:1511] Processing CreateTablet for tablet db0d9af34f2d452f8fffa06d1f28b163 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:56.783665  3334 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa99770647b414da871053c87e2801d (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:56.783839  3332 tablet_service.cc:1511] Processing CreateTablet for tablet 32f12414843040469cd7c77fa2e70fca (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:56.781760  3331 tablet_service.cc:1511] Processing CreateTablet for tablet 8357544c95e94921a033345960c24b44 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:56.787016  3336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0d9af34f2d452f8fffa06d1f28b163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.783695  3330 tablet_service.cc:1511] Processing CreateTablet for tablet 26d56bfff00b4f1cb82ea7202333dbde (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:56.778132  3333 tablet_service.cc:1511] Processing CreateTablet for tablet 02ad1834656e42719c29e789305c6d59 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:56.787367  3482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ad1834656e42719c29e789305c6d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.794808  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce30e4a66534c948f64b15993ba3ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.795635  3483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa99770647b414da871053c87e2801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.790298  3334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa99770647b414da871053c87e2801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.788261  3328 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5b18d134e49d78a2e60d482dc7638 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:56.790478  3329 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce30e4a66534c948f64b15993ba3ead (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:56.797264  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8357544c95e94921a033345960c24b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.797497  3333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ad1834656e42719c29e789305c6d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.800041  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d56bfff00b4f1cb82ea7202333dbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.800516  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d56bfff00b4f1cb82ea7202333dbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.804787  3329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce30e4a66534c948f64b15993ba3ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.816615  3332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f12414843040469cd7c77fa2e70fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.818853  3331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8357544c95e94921a033345960c24b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.822400  3328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5b18d134e49d78a2e60d482dc7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.820099  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f12414843040469cd7c77fa2e70fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.835188  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5b18d134e49d78a2e60d482dc7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.839253  3484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d35ecc1bc4cc7acd530b660776d6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:56.858287  3291 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:56.902966  3411 tablet_service.cc:1511] Processing CreateTablet for tablet db0d9af34f2d452f8fffa06d1f28b163 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:56.904495  3411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db0d9af34f2d452f8fffa06d1f28b163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.907879  3410 tablet_service.cc:1511] Processing CreateTablet for tablet 548d35ecc1bc4cc7acd530b660776d6c (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:56.913339  3408 tablet_service.cc:1511] Processing CreateTablet for tablet 02ad1834656e42719c29e789305c6d59 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:56.915596  3410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d35ecc1bc4cc7acd530b660776d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.929494  3404 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce30e4a66534c948f64b15993ba3ead (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:56.934417  3408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ad1834656e42719c29e789305c6d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.913226  3409 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa99770647b414da871053c87e2801d (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:56.934469  3407 tablet_service.cc:1511] Processing CreateTablet for tablet 32f12414843040469cd7c77fa2e70fca (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:56.936108  3405 tablet_service.cc:1511] Processing CreateTablet for tablet 26d56bfff00b4f1cb82ea7202333dbde (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:56.932194  3406 tablet_service.cc:1511] Processing CreateTablet for tablet 8357544c95e94921a033345960c24b44 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:56.944469  3403 tablet_service.cc:1511] Processing CreateTablet for tablet 88a5b18d134e49d78a2e60d482dc7638 (DEFAULT_TABLE table=test-workload [id=d341ac1a2c26480e93e1f52d922d7c93]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:56.947803  3404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce30e4a66534c948f64b15993ba3ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.950321  3405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d56bfff00b4f1cb82ea7202333dbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.970248  3407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f12414843040469cd7c77fa2e70fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.975181  3406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8357544c95e94921a033345960c24b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:56.983237  3409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa99770647b414da871053c87e2801d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:57.005791  3403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a5b18d134e49d78a2e60d482dc7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:57.003887  3537 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.074891  3538 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.094736  3539 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.109264  3537 tablet_bootstrap.cc:654] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.114756  3539 tablet_bootstrap.cc:654] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.118460  3538 tablet_bootstrap.cc:654] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.134958  3538 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.135628  3538 ts_tablet_manager.cc:1403] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.008s
I20260709 12:11:57.137627  3537 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.138116  3537 ts_tablet_manager.cc:1403] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.021s
I20260709 12:11:57.139169  3539 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.139762  3539 ts_tablet_manager.cc:1403] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.016s
I20260709 12:11:57.139142  3538 raft_consensus.cc:359] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.140228  3538 raft_consensus.cc:385] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.140594  3538 raft_consensus.cc:740] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.141180  3537 raft_consensus.cc:359] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.141914  3537 raft_consensus.cc:385] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.141402  3538 consensus_queue.cc:260] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.142220  3537 raft_consensus.cc:740] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.142835  3539 raft_consensus.cc:359] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.143872  3539 raft_consensus.cc:385] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.144220  3539 raft_consensus.cc:740] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.143532  3537 consensus_queue.cc:260] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.145015  3539 consensus_queue.cc:260] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.149688  3446 heartbeater.cc:499] Master 127.3.34.254:43721 was elected leader, sending a full tablet report...
I20260709 12:11:57.150818  3539 ts_tablet_manager.cc:1434] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:11:57.152019  3539 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.160877  3520 heartbeater.cc:499] Master 127.3.34.254:43721 was elected leader, sending a full tablet report...
I20260709 12:11:57.161816  3371 heartbeater.cc:499] Master 127.3.34.254:43721 was elected leader, sending a full tablet report...
I20260709 12:11:57.162326  3537 ts_tablet_manager.cc:1434] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.006s
I20260709 12:11:57.163297  3537 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.167347  3539 tablet_bootstrap.cc:654] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.170302  3537 tablet_bootstrap.cc:654] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.160874  3538 ts_tablet_manager.cc:1434] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.014s
I20260709 12:11:57.172591  3538 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.184676  3538 tablet_bootstrap.cc:654] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.195798  3537 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
W20260709 12:11:57.196084  3372 tablet.cc:2406] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:11:57.196362  3537 ts_tablet_manager.cc:1403] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.012s
I20260709 12:11:57.199417  3539 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.200117  3539 ts_tablet_manager.cc:1403] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.022s
I20260709 12:11:57.199643  3537 raft_consensus.cc:359] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.200644  3537 raft_consensus.cc:385] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.200996  3537 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.201838  3537 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.204428  3537 ts_tablet_manager.cc:1434] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:11:57.205461  3537 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.213301  3537 tablet_bootstrap.cc:654] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.214516  3539 raft_consensus.cc:359] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.215415  3539 raft_consensus.cc:385] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.215802  3539 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.216848  3539 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.221948  3538 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.222447  3538 ts_tablet_manager.cc:1403] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.004s
I20260709 12:11:57.222493  3537 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.223524  3537 ts_tablet_manager.cc:1403] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 12:11:57.225708  3538 raft_consensus.cc:359] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.226506  3539 ts_tablet_manager.cc:1434] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:11:57.226470  3538 raft_consensus.cc:385] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.226395  3537 raft_consensus.cc:359] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.227030  3538 raft_consensus.cc:740] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.227226  3537 raft_consensus.cc:385] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.227557  3537 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.228243  3537 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.228130  3538 consensus_queue.cc:260] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.230806  3538 ts_tablet_manager.cc:1434] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:11:57.231894  3538 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.234232  3537 ts_tablet_manager.cc:1434] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:11:57.235222  3537 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.238732  3538 tablet_bootstrap.cc:654] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.240924  3539 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.243520  3544 raft_consensus.cc:493] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.244071  3544 raft_consensus.cc:515] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.247269  3544 leader_election.cc:290] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.248833  3539 tablet_bootstrap.cc:654] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.255678  3537 tablet_bootstrap.cc:654] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.270233  3537 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.270794  3537 ts_tablet_manager.cc:1403] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.008s
I20260709 12:11:57.275841  3537 raft_consensus.cc:359] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.277757  3537 raft_consensus.cc:385] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.278139  3537 raft_consensus.cc:740] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.279109  3537 consensus_queue.cc:260] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.272847  3538 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.283059  3538 ts_tablet_manager.cc:1403] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.008s
I20260709 12:11:57.284602  3537 ts_tablet_manager.cc:1434] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:11:57.289772  3539 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.290326  3539 ts_tablet_manager.cc:1403] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.016s
I20260709 12:11:57.292186  3537 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.293560  3539 raft_consensus.cc:359] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.294472  3539 raft_consensus.cc:385] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.294780  3539 raft_consensus.cc:740] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.295776  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.295637  3539 consensus_queue.cc:260] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.297448  3544 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.298111  3539 ts_tablet_manager.cc:1434] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:11:57.297943  3544 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.299109  3539 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.300173  3544 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.302130  3538 raft_consensus.cc:359] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.303140  3538 raft_consensus.cc:385] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.303520  3538 raft_consensus.cc:740] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
W20260709 12:11:57.304207  3312 leader_election.cc:343] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.304368  3538 consensus_queue.cc:260] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.305204  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.306841  3539 tablet_bootstrap.cc:654] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
W20260709 12:11:57.306740  3312 leader_election.cc:343] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.312870  3537 tablet_bootstrap.cc:654] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.318903  3495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.320013  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
W20260709 12:11:57.321098  3312 leader_election.cc:343] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.321532  3312 leader_election.cc:304] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.321832  3545 raft_consensus.cc:493] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.322412  3544 raft_consensus.cc:2749] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:57.322315  3545 raft_consensus.cc:515] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
W20260709 12:11:57.323383  3312 leader_election.cc:343] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.323815  3312 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.324513  3544 raft_consensus.cc:2749] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:57.319271  3538 ts_tablet_manager.cc:1434] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:11:57.327134  3545 leader_election.cc:290] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.333300  3538 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.334707  3539 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.335389  3539 ts_tablet_manager.cc:1403] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.007s
I20260709 12:11:57.339428  3539 raft_consensus.cc:359] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.340466  3539 raft_consensus.cc:385] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.340900  3539 raft_consensus.cc:740] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.341864  3539 consensus_queue.cc:260] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.344193  3538 tablet_bootstrap.cc:654] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.344542  3539 ts_tablet_manager.cc:1434] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:11:57.346431  3539 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.353480  3537 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.354074  3537 ts_tablet_manager.cc:1403] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.005s
I20260709 12:11:57.355062  3545 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.355201  3539 tablet_bootstrap.cc:654] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.355607  3545 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.357717  3545 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.357411  3537 raft_consensus.cc:359] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.358353  3537 raft_consensus.cc:385] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.358724  3537 raft_consensus.cc:740] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.359520  3537 consensus_queue.cc:260] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.366035  3537 ts_tablet_manager.cc:1434] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:11:57.369436  3537 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.367832  3539 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.369530  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.371228  3539 ts_tablet_manager.cc:1403] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 12:11:57.371315  3345 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 0.
I20260709 12:11:57.367156  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.374053  3387 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:57.374568  3539 raft_consensus.cc:359] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.374974  3545 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.375425  3539 raft_consensus.cc:385] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.375509  3545 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.375836  3539 raft_consensus.cc:740] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.375999  3545 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.376572  3539 consensus_queue.cc:260] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.385143  3539 ts_tablet_manager.cc:1434] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:11:57.386004  3545 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
W20260709 12:11:57.387181  3387 leader_election.cc:343] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.387311  3539 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.390257  3563 raft_consensus.cc:493] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.391064  3538 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.390799  3563 raft_consensus.cc:515] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.391824  3538 ts_tablet_manager.cc:1403] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.011s
I20260709 12:11:57.391906  3543 raft_consensus.cc:493] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.392510  3543 raft_consensus.cc:515] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.393141  3563 leader_election.cc:290] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.393867  3544 raft_consensus.cc:493] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.394371  3544 raft_consensus.cc:515] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.394804  3545 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.396724  3544 leader_election.cc:290] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.398473  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
W20260709 12:11:57.400311  3312 leader_election.cc:343] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.400403  3538 raft_consensus.cc:359] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.401341  3538 raft_consensus.cc:385] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.401678  3538 raft_consensus.cc:740] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.402285  3539 tablet_bootstrap.cc:654] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.403327  3543 leader_election.cc:290] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.389040  3537 tablet_bootstrap.cc:654] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.402590  3538 consensus_queue.cc:260] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.411418  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.412145  3346 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 0.
I20260709 12:11:57.414531  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.415189  3346 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.416782  3538 ts_tablet_manager.cc:1434] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:11:57.417920  3538 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.417701  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
W20260709 12:11:57.420501  3461 leader_election.cc:343] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.428755  3538 tablet_bootstrap.cc:654] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.430728  3346 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.432174  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
W20260709 12:11:57.433563  3312 leader_election.cc:343] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.434027  3312 leader_election.cc:304] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.434924  3544 raft_consensus.cc:2749] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:57.438464  3387 leader_election.cc:304] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:57.439497  3545 raft_consensus.cc:2804] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.439596  3387 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:57.440023  3545 raft_consensus.cc:493] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.440510  3545 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.443269  3563 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.447916  3545 raft_consensus.cc:515] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.450413  3563 raft_consensus.cc:697] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:57.450928  3545 leader_election.cc:290] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.451611  3563 consensus_queue.cc:237] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.453639  3538 tablet_bootstrap.cc:492] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.454140  3538 ts_tablet_manager.cc:1403] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.002s
I20260709 12:11:57.454734  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.455497  3346 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.456782  3537 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.457342  3538 raft_consensus.cc:359] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.458163  3538 raft_consensus.cc:385] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.458469  3538 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.459012  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.459280  3538 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.459951  3494 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 0.
I20260709 12:11:57.461576  3538 ts_tablet_manager.cc:1434] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:11:57.457363  3537 ts_tablet_manager.cc:1403] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.004s
I20260709 12:11:57.462613  3538 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.463344  3346 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.468540  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.470703  3495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.474591  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:57.477183  3493 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.477130  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:57.479939  3543 raft_consensus.cc:493] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.480597  3543 raft_consensus.cc:515] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.481492  3538 tablet_bootstrap.cc:654] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.483637  3543 leader_election.cc:290] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.484236  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.484894  3345 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 0.
I20260709 12:11:57.485725  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.486512  3461 leader_election.cc:304] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:11:57.486764  3421 raft_consensus.cc:2468] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 0.
I20260709 12:11:57.487924  3543 raft_consensus.cc:2804] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.488422  3543 raft_consensus.cc:493] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.488900  3543 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.490785  3493 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.495697  3461 leader_election.cc:304] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.496354  3537 raft_consensus.cc:359] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.498202  3537 raft_consensus.cc:385] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.498914  3537 raft_consensus.cc:740] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.500597  3537 consensus_queue.cc:260] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.504626  3537 ts_tablet_manager.cc:1434] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 12:11:57.507817  3539 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.511631  3539 ts_tablet_manager.cc:1403] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.007s
I20260709 12:11:57.512701  3538 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.513243  3538 ts_tablet_manager.cc:1403] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.000s
I20260709 12:11:57.513300  3543 raft_consensus.cc:515] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.515161  3539 raft_consensus.cc:359] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.517027  3539 raft_consensus.cc:385] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.517148  3537 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.517397  3539 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.515552  3543 leader_election.cc:290] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.516238  3538 raft_consensus.cc:359] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.518167  3539 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.518831  3538 raft_consensus.cc:385] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.519250  3538 raft_consensus.cc:740] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.520098  3538 consensus_queue.cc:260] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.522509  3543 raft_consensus.cc:2804] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.522884  3543 raft_consensus.cc:493] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.523244  3543 raft_consensus.cc:3060] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.524767  3537 tablet_bootstrap.cc:654] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.500921  3387 leader_election.cc:304] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:57.527367  3563 raft_consensus.cc:2804] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.526788  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.527956  3563 raft_consensus.cc:697] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:57.528412  3346 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.529877  3387 leader_election.cc:304] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.528905  3563 consensus_queue.cc:237] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.531179  3568 raft_consensus.cc:2804] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.532338  3568 raft_consensus.cc:493] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.532675  3568 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.526810  3539 ts_tablet_manager.cc:1434] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 12:11:57.536500  3387 leader_election.cc:343] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:11:57.537408  3387 leader_election.cc:343] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.540549  3538 ts_tablet_manager.cc:1434] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:11:57.541589  3538 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.542004  3346 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 1.
I20260709 12:11:57.542042  3543 raft_consensus.cc:515] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.543457  3461 leader_election.cc:304] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:11:57.544209  3543 leader_election.cc:290] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.546149  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
W20260709 12:11:57.548199  3461 leader_election.cc:343] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.549847  3545 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.550544  3545 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.544768  3543 raft_consensus.cc:2804] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.552861  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:57.553838  3419 raft_consensus.cc:3060] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.551208  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:57.556469  3538 tablet_bootstrap.cc:654] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.556912  3242 catalog_manager.cc:5697] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.554445  3543 raft_consensus.cc:697] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:11:57.558061  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.562618  3545 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
W20260709 12:11:57.557406  3461 leader_election.cc:343] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.564806  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.565109  3568 raft_consensus.cc:515] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
W20260709 12:11:57.565447  3461 leader_election.cc:343] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.566762  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.567433  3345 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 0.
W20260709 12:11:57.566794  3387 leader_election.cc:343] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.569191  3387 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:11:57.570283  3545 raft_consensus.cc:2804] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.570690  3545 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.571092  3545 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.571926  3419 raft_consensus.cc:2468] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 1.
I20260709 12:11:57.573307  3543 consensus_queue.cc:237] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.574209  3539 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.576562  3461 leader_election.cc:304] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.585258  3573 raft_consensus.cc:2804] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.586005  3573 raft_consensus.cc:697] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:11:57.589321  3563 raft_consensus.cc:493] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.589816  3563 raft_consensus.cc:515] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.591091  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.590168  3568 leader_election.cc:290] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
W20260709 12:11:57.596055  3387 leader_election.cc:343] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.596547  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:57.597820  3493 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.587085  3573 consensus_queue.cc:237] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.601398  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.602713  3563 leader_election.cc:290] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.605387  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.606098  3494 raft_consensus.cc:2468] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 0.
W20260709 12:11:57.605046  3387 leader_election.cc:343] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.607228  3537 tablet_bootstrap.cc:492] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.607741  3537 ts_tablet_manager.cc:1403] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.006s
I20260709 12:11:57.607831  3387 leader_election.cc:304] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.609752  3563 raft_consensus.cc:2804] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.610219  3563 raft_consensus.cc:493] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.610622  3563 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.610559  3493 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.612483  3387 leader_election.cc:304] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.613627  3577 raft_consensus.cc:2804] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.614537  3577 raft_consensus.cc:697] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:57.615442  3577 consensus_queue.cc:237] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.615772  3537 raft_consensus.cc:359] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.616364  3545 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.618692  3537 raft_consensus.cc:385] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.623548  3545 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.623967  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.624514  3345 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.622560  3538 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.630347  3539 tablet_bootstrap.cc:654] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.623023  3537 raft_consensus.cc:740] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.634966  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:57.633133  3538 ts_tablet_manager.cc:1403] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.005s
I20260709 12:11:57.632501  3537 consensus_queue.cc:260] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.641664  3537 ts_tablet_manager.cc:1434] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:11:57.642701  3537 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.644794  3241 catalog_manager.cc:5697] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:57.639662  3387 leader_election.cc:343] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.669724  3345 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.675523  3387 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:11:57.677013  3545 raft_consensus.cc:2804] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.677819  3545 raft_consensus.cc:697] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:57.678946  3545 consensus_queue.cc:237] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.686935  3538 raft_consensus.cc:359] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.696295  3538 raft_consensus.cc:385] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.696696  3538 raft_consensus.cc:740] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.700503  3544 raft_consensus.cc:493] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.701301  3538 consensus_queue.cc:260] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.715020  3538 ts_tablet_manager.cc:1434] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.005s
I20260709 12:11:57.716050  3538 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.700956  3563 raft_consensus.cc:515] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.720026  3563 leader_election.cc:290] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.711294  3544 raft_consensus.cc:515] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.722148  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.722558  3544 leader_election.cc:290] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.723464  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:57.703651  3537 tablet_bootstrap.cc:654] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.724217  3493 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.725767  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.732347  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
W20260709 12:11:57.733067  3387 leader_election.cc:343] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.733752  3494 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 0.
W20260709 12:11:57.734943  3312 leader_election.cc:343] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.736050  3312 leader_election.cc:304] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.737110  3544 raft_consensus.cc:2804] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.737457  3544 raft_consensus.cc:493] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.737771  3544 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.741518  3539 tablet_bootstrap.cc:492] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.742012  3539 ts_tablet_manager.cc:1403] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.185s	user 0.027s	sys 0.042s
I20260709 12:11:57.742151  3241 catalog_manager.cc:5697] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.746304  3538 tablet_bootstrap.cc:654] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.742220  3493 raft_consensus.cc:2468] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 1.
I20260709 12:11:57.749658  3387 leader_election.cc:304] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.752681  3545 raft_consensus.cc:2804] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.753180  3545 raft_consensus.cc:697] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:57.753917  3545 consensus_queue.cc:237] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.747211  3544 raft_consensus.cc:515] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.764407  3544 leader_election.cc:290] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 election: Requested vote from peers 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.765826  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:57.767283  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
W20260709 12:11:57.767458  3312 leader_election.cc:343] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.767896  3493 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.767885  3539 raft_consensus.cc:359] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.768800  3539 raft_consensus.cc:385] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.769156  3539 raft_consensus.cc:740] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.771947  3537 tablet_bootstrap.cc:492] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.772399  3537 ts_tablet_manager.cc:1403] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.027s
I20260709 12:11:57.773424  3573 raft_consensus.cc:493] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.773460  3241 catalog_manager.cc:5697] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.774103  3573 raft_consensus.cc:515] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.775106  3493 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 1.
I20260709 12:11:57.775007  3537 raft_consensus.cc:359] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.775686  3537 raft_consensus.cc:385] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.775954  3537 raft_consensus.cc:740] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.776229  3573 leader_election.cc:290] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.776307  3312 leader_election.cc:304] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.777526  3544 raft_consensus.cc:2804] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.778664  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.779229  3538 tablet_bootstrap.cc:492] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.779632  3538 ts_tablet_manager.cc:1403] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.002s
I20260709 12:11:57.769830  3539 consensus_queue.cc:260] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.780315  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.781996  3539 ts_tablet_manager.cc:1434] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
W20260709 12:11:57.781894  3461 leader_election.cc:343] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.779503  3345 raft_consensus.cc:2468] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 0.
I20260709 12:11:57.782173  3538 raft_consensus.cc:359] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.782810  3538 raft_consensus.cc:385] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.783001  3539 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.783123  3538 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.783551  3461 leader_election.cc:304] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.783957  3538 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.784669  3573 raft_consensus.cc:2804] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:57.785022  3573 raft_consensus.cc:493] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.785372  3573 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.788734  3538 ts_tablet_manager.cc:1434] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:11:57.789681  3538 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: Bootstrap starting.
I20260709 12:11:57.789825  3241 catalog_manager.cc:5697] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.791323  3539 tablet_bootstrap.cc:654] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.776611  3537 consensus_queue.cc:260] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.796458  3544 raft_consensus.cc:697] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:11:57.796310  3241 catalog_manager.cc:5697] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.794246  3573 raft_consensus.cc:515] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.797372  3544 consensus_queue.cc:237] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:57.800676  3573 leader_election.cc:290] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:57.802435  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:57.811555  3537 ts_tablet_manager.cc:1434] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.007s
I20260709 12:11:57.812469  3539 tablet_bootstrap.cc:492] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.812386  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:57.812994  3539 ts_tablet_manager.cc:1403] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.010s
I20260709 12:11:57.813146  3345 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.812668  3537 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: Bootstrap starting.
I20260709 12:11:57.813946  3538 tablet_bootstrap.cc:654] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.819940  3539 raft_consensus.cc:359] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.820748  3537 tablet_bootstrap.cc:654] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.820623  3345 raft_consensus.cc:2468] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 1.
I20260709 12:11:57.820859  3539 raft_consensus.cc:385] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.821280  3539 raft_consensus.cc:740] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.821946  3461 leader_election.cc:304] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:11:57.823222  3573 raft_consensus.cc:2804] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:57.823827  3573 raft_consensus.cc:697] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
W20260709 12:11:57.824148  3461 leader_election.cc:343] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:57.824993  3573 consensus_queue.cc:237] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.826020  3539 consensus_queue.cc:260] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.829398  3539 ts_tablet_manager.cc:1434] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:11:57.830538  3539 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: Bootstrap starting.
I20260709 12:11:57.837589  3538 tablet_bootstrap.cc:492] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: No bootstrap required, opened a new log
I20260709 12:11:57.838073  3538 ts_tablet_manager.cc:1403] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.013s
I20260709 12:11:57.841287  3537 tablet_bootstrap.cc:492] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: No bootstrap required, opened a new log
I20260709 12:11:57.841677  3537 ts_tablet_manager.cc:1403] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 12:11:57.844666  3539 tablet_bootstrap.cc:654] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:57.845083  3537 raft_consensus.cc:359] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.845817  3537 raft_consensus.cc:385] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.846067  3537 raft_consensus.cc:740] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.846076  3243 catalog_manager.cc:5697] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.849471  3538 raft_consensus.cc:359] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.850203  3538 raft_consensus.cc:385] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:57.850458  3538 raft_consensus.cc:740] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.850827  3537 consensus_queue.cc:260] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.851112  3538 consensus_queue.cc:260] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.853699  3538 ts_tablet_manager.cc:1434] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:11:57.856925  3537 ts_tablet_manager.cc:1434] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:11:57.862104  3539 tablet_bootstrap.cc:492] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: No bootstrap required, opened a new log
I20260709 12:11:57.862524  3539 ts_tablet_manager.cc:1403] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 12:11:57.863426  3242 catalog_manager.cc:5697] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.865041  3539 raft_consensus.cc:359] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.865775  3539 raft_consensus.cc:385] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:11:57.866156  3291 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:57.866137  3539 raft_consensus.cc:740] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Initialized, Role: FOLLOWER
I20260709 12:11:57.867230  3539 consensus_queue.cc:260] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.869231  3539 ts_tablet_manager.cc:1434] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 12:11:57.876610  3241 catalog_manager.cc:5697] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.938586  3544 raft_consensus.cc:493] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.939234  3544 raft_consensus.cc:515] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.941510  3544 leader_election.cc:290] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.942287  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:57.942847  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a5b18d134e49d78a2e60d482dc7638" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.943183  3419 raft_consensus.cc:2393] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bb38e29d34846f98bf5a8548c92dd7d in current term 1: Already voted for candidate 3e41a4247b314aa09d7917b2f2186c32 in this term.
I20260709 12:11:57.944465  3312 leader_election.cc:304] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:57.945132  3544 raft_consensus.cc:3060] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.952075  3544 raft_consensus.cc:2749] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:57.971112  3545 raft_consensus.cc:493] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.971637  3545 raft_consensus.cc:515] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:57.973600  3545 leader_election.cc:290] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:57.974895  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:57.975348  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:57.975685  3346 raft_consensus.cc:2393] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc99371cc44742118d325bc1e75f2c88 in current term 1: Already voted for candidate 3e41a4247b314aa09d7917b2f2186c32 in this term.
I20260709 12:11:57.976738  3545 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:57.977154  3387 leader_election.cc:304] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc99371cc44742118d325bc1e75f2c88; no voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:57.977955  3563 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:57.984495  3573 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:57.984939  3563 raft_consensus.cc:2749] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:57.998337  3544 raft_consensus.cc:493] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.998857  3544 raft_consensus.cc:515] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.003750  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:58.004797  3493 raft_consensus.cc:2393] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bb38e29d34846f98bf5a8548c92dd7d in current term 1: Already voted for candidate dc99371cc44742118d325bc1e75f2c88 in this term.
I20260709 12:11:58.006382  3544 leader_election.cc:290] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.012501  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:58.019837  3493 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.027977  3312 leader_election.cc:304] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:58.027763  3577 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:58.029176  3544 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.049180  3419 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.058534  3573 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.060628  3577 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.063560  3544 raft_consensus.cc:2749] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:58.104456  3568 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.104132  3545 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:11:58.114068  3573 consensus_queue.cc:1048] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.116194  3544 raft_consensus.cc:493] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.116693  3544 raft_consensus.cc:515] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.120148  3544 leader_election.cc:290] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.122153  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:58.125136  3492 raft_consensus.cc:2393] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bb38e29d34846f98bf5a8548c92dd7d in current term 1: Already voted for candidate dc99371cc44742118d325bc1e75f2c88 in this term.
I20260709 12:11:58.139209  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:58.140760  3312 leader_election.cc:304] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:58.146699  3544 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.175367  3544 raft_consensus.cc:2749] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:58.182020  3573 consensus_queue.cc:1048] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.186395  3568 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.191849  3590 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:58.199954  3494 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.200425  3563 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:58.218694  3421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:11:58.219628  3421 raft_consensus.cc:606] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:58.232214  3572 consensus_queue.cc:1048] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:11:58.236838  3572 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.237506  3572 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.238185  3563 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.233786  3421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:11:58.239100  3421 raft_consensus.cc:606] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:58.243069  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:58.246333  3563 raft_consensus.cc:493] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.252506  3563 raft_consensus.cc:515] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:11:58.266502  3563 leader_election.cc:290] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795), 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495)
I20260709 12:11:58.258455  3572 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:11:58.268059  3421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc99371cc44742118d325bc1e75f2c88" is_pre_election: true
I20260709 12:11:58.280004  3421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ad1834656e42719c29e789305c6d59"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:11:58.280834  3421 raft_consensus.cc:606] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:58.282150  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e41a4247b314aa09d7917b2f2186c32" is_pre_election: true
I20260709 12:11:58.289289  3344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" is_pre_election: true
I20260709 12:11:58.289781  3461 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32; no voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:58.296814  3573 raft_consensus.cc:2749] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:11:58.302563  3421 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:58.313215  3563 consensus_queue.cc:1048] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.321193  3563 raft_consensus.cc:993] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.321720  3563 raft_consensus.cc:1081] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.323474  3568 consensus_queue.cc:1048] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.325241  3387 leader_election.cc:304] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc99371cc44742118d325bc1e75f2c88; no voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:11:58.326072  3563 raft_consensus.cc:2749] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:58.326190  3494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:35208
I20260709 12:11:58.326974  3544 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.328318  3494 raft_consensus.cc:606] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:58.333134  3346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:11:58.333740  3346 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.334126  3346 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.334421  3493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:35208
I20260709 12:11:58.335042  3493 raft_consensus.cc:606] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:11:58.344851  3346 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.346038  3344 raft_consensus.cc:1240] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Rejecting Update request from peer dc99371cc44742118d325bc1e75f2c88 for earlier term 1. Current term is 2. Ops: []
I20260709 12:11:58.351879  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:58.352499  3494 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.353329  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:58.353929  3419 raft_consensus.cc:3055] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:58.354266  3419 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:58.354662  3346 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Requested vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.355693  3419 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.357287  3543 consensus_queue.cc:1048] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:58.358551  3419 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.361581  3494 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.362731  3312 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:11:58.363543  3544 raft_consensus.cc:2804] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:58.363981  3544 raft_consensus.cc:697] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:11:58.364825  3544 consensus_queue.cc:237] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.372131  3573 raft_consensus.cc:993] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:11:58.372684  3573 raft_consensus.cc:1081] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:11:58.374353  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49392
I20260709 12:11:58.374902  3420 raft_consensus.cc:493] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.375396  3420 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.383163  3563 raft_consensus.cc:993] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.383651  3568 raft_consensus.cc:1081] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.385923  3345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:11:58.386502  3345 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.387050  3345 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.386515  3242 catalog_manager.cc:5697] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 1 to 2, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.388537  3419 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.389439  3420 raft_consensus.cc:515] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.392282  3420 leader_election.cc:290] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.393007  3345 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.394014  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:58.394578  3346 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.394798  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ce30e4a66534c948f64b15993ba3ead" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:58.395448  3494 raft_consensus.cc:3055] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:58.395771  3494 raft_consensus.cc:740] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:11:58.396566  3494 consensus_queue.cc:260] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.397782  3494 raft_consensus.cc:3060] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.398242  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:58.398821  3420 raft_consensus.cc:3055] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:58.399204  3420 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:58.400126  3420 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.401201  3420 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.401144  3346 raft_consensus.cc:2468] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:11:58.402598  3387 leader_election.cc:304] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:58.403431  3568 raft_consensus.cc:2804] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:58.403954  3345 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Requested vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.404052  3568 raft_consensus.cc:697] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:58.405110  3568 consensus_queue.cc:237] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.408299  3420 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.408070  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:58.409137  3493 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.409351  3312 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:58.411340  3590 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:58.411805  3590 raft_consensus.cc:697] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:11:58.412627  3590 consensus_queue.cc:237] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.417234  3493 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.419525  3494 raft_consensus.cc:2468] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:11:58.433720  3240 catalog_manager.cc:5697] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 1 to 2, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.434768  3242 catalog_manager.cc:5697] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 1 to 2, leader changed from 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.618376  3572 raft_consensus.cc:993] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:11:58.618870  3543 raft_consensus.cc:1081] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:11:58.620623  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49392
I20260709 12:11:58.621215  3420 raft_consensus.cc:493] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.621600  3420 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.626055  3420 raft_consensus.cc:515] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.627717  3420 leader_election.cc:290] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.628659  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:11:58.628963  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:58.629264  3345 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.629580  3494 raft_consensus.cc:3055] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:58.629932  3494 raft_consensus.cc:740] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:11:58.630746  3494 consensus_queue.cc:260] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.631961  3494 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.634106  3345 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:11:58.635178  3387 leader_election.cc:304] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:58.635922  3568 raft_consensus.cc:2804] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:58.636385  3568 raft_consensus.cc:697] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:58.637200  3568 consensus_queue.cc:237] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.638886  3494 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:11:58.643994  3242 catalog_manager.cc:5697] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 1 to 2, leader changed from 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.774782  3563 raft_consensus.cc:993] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.775373  3563 raft_consensus.cc:1081] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:11:58.777040  3345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ad1834656e42719c29e789305c6d59"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:11:58.777552  3345 raft_consensus.cc:493] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:58.777894  3345 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.784933  3345 raft_consensus.cc:515] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.787689  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:11:58.788444  3420 raft_consensus.cc:3055] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:58.788905  3420 raft_consensus.cc:740] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:11:58.790181  3494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:11:58.790005  3420 consensus_queue.cc:260] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.790772  3494 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.791471  3420 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:58.792349  3345 leader_election.cc:290] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Requested vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:11:58.797003  3420 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.798240  3312 leader_election.cc:304] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:11:58.798357  3494 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:11:58.799086  3590 raft_consensus.cc:2804] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:58.799566  3590 raft_consensus.cc:697] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:11:58.800333  3590 consensus_queue.cc:237] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:11:58.807655  3242 catalog_manager.cc:5697] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 1 to 2, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.808967  3494 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.810287  3590 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:58.821264  3420 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.822726  3544 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:58.835891  3420 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.837687  3544 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:58.847966  3494 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.849946  3544 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:58.864905  3345 raft_consensus.cc:1275] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.867030  3568 consensus_queue.cc:1048] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:58.883551  3494 raft_consensus.cc:1275] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:58.887383  3568 consensus_queue.cc:1048] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:59.199128  3345 raft_consensus.cc:1275] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:59.200700  3628 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:59.209401  3494 raft_consensus.cc:1275] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:59.210973  3568 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:59.273526  3420 raft_consensus.cc:1275] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:59.274874  3544 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:59.285214  3494 raft_consensus.cc:1275] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:59.287359  3626 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:01.371500  3211 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:12:01.372370  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:01.397017  3419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:01.397562  3419 raft_consensus.cc:606] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Received request to transfer leadership to TS 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:12:01.408660  3346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
mode: GRACEFUL
new_leader_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:58352
I20260709 12:12:01.409224  3346 raft_consensus.cc:606] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Received request to transfer leadership to TS 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:12:01.410421  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:01.410959  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:01.712497  3626 raft_consensus.cc:993] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: : Instructing follower 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:01.712946  3638 raft_consensus.cc:1081] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Signalling peer 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:01.714488  3494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:35186
I20260709 12:12:01.715052  3494 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.715370  3494 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.719878  3494 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.721741  3494 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 3 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:12:01.722419  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:01.722960  3346 raft_consensus.cc:3055] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.723089  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:01.723318  3346 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:01.723701  3419 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.724136  3346 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.725369  3346 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.728469  3419 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 3.
I20260709 12:12:01.729614  3461 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:01.730489  3634 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.731956  3634 raft_consensus.cc:697] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:01.732079  3346 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 3.
I20260709 12:12:01.732810  3634 consensus_queue.cc:237] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.742787  3242 catalog_manager.cc:5697] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 2 to 3, leader changed from 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193) to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.873759  3568 raft_consensus.cc:993] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:01.874183  3568 raft_consensus.cc:1081] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Signalling peer 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:01.875687  3494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:35200
I20260709 12:12:01.876230  3494 raft_consensus.cc:493] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.876632  3494 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:01.881175  3494 raft_consensus.cc:515] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.882905  3494 leader_election.cc:290] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 2 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:12:01.883819  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:01.884066  3419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:01.884560  3346 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:01.884725  3419 raft_consensus.cc:3055] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:01.885113  3419 raft_consensus.cc:740] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:01.886020  3419 consensus_queue.cc:260] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.887396  3419 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:01.891929  3346 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 2.
I20260709 12:12:01.893354  3461 leader_election.cc:304] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:01.894047  3419 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 2.
I20260709 12:12:01.894148  3634 raft_consensus.cc:2804] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:01.894599  3634 raft_consensus.cc:697] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:01.895473  3634 consensus_queue.cc:237] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:01.902192  3242 catalog_manager.cc:5697] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 1 to 2, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.143240  3419 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.144361  3634 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.161046  3346 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:02.163245  3634 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:02.284777  3419 raft_consensus.cc:1275] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:02.286473  3634 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:02.298568  3346 raft_consensus.cc:1275] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:02.300042  3639 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:02.412066  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.417423  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:02.417810  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:03.418814  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.424154  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:03.424542  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:04.425987  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.432171  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:04.432843  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.434348  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.439379  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:05.439729  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:06.440873  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.446862  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:06.447392  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.448376  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.455332  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:07.455806  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.456941  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:08.462675  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:08.463165  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:09.464092  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.469249  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:09.469723  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.470690  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.476212  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.476632  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:11.508666  3211 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:11.524021  3345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:42008
I20260709 12:12:11.524848  3345 raft_consensus.cc:606] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:12:11.531584  3345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:42008
I20260709 12:12:11.532159  3345 raft_consensus.cc:606] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:12:11.537564  3493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:35208
I20260709 12:12:11.538084  3493 raft_consensus.cc:606] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:12:11.542445  3665 raft_consensus.cc:993] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.543030  3665 raft_consensus.cc:1081] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.543606  3345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ad1834656e42719c29e789305c6d59"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:42008
I20260709 12:12:11.544232  3345 raft_consensus.cc:606] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:12:11.544878  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:12:11.545439  3420 raft_consensus.cc:493] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:11.545722  3420 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:11.550702  3420 raft_consensus.cc:515] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:11.551761  3493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
mode: GRACEFUL
new_leader_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:35208
I20260709 12:12:11.552304  3493 raft_consensus.cc:606] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 LEADER]: Received request to transfer leadership to TS dc99371cc44742118d325bc1e75f2c88
I20260709 12:12:11.552906  3420 leader_election.cc:290] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Requested vote from peers 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795), 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495)
I20260709 12:12:11.553593  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:11.554440  3493 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:11.554356  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:11.555027  3345 raft_consensus.cc:3055] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:11.555383  3345 raft_consensus.cc:740] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:11.556211  3345 consensus_queue.cc:260] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:11.557197  3345 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:11.559757  3493 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:12:11.561123  3387 leader_election.cc:304] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:11.562216  3655 raft_consensus.cc:2804] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:11.562541  3345 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 2.
I20260709 12:12:11.563697  3655 raft_consensus.cc:697] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:11.564626  3655 consensus_queue.cc:237] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:11.572789  3241 catalog_manager.cc:5697] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 1 to 2, leader changed from 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.610816  3662 raft_consensus.cc:993] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.611608  3653 raft_consensus.cc:1081] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.612920  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49392
I20260709 12:12:11.613381  3420 raft_consensus.cc:493] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:11.613811  3420 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:11.618208  3420 raft_consensus.cc:515] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.619717  3420 leader_election.cc:290] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:11.620564  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:11.620826  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f12414843040469cd7c77fa2e70fca" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:11.621127  3345 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:11.621359  3493 raft_consensus.cc:3055] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:11.621695  3493 raft_consensus.cc:740] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:11.622370  3493 consensus_queue.cc:260] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.623320  3493 raft_consensus.cc:3060] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:11.625520  3345 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:11.626394  3387 leader_election.cc:304] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:11.627065  3655 raft_consensus.cc:2804] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:11.627570  3655 raft_consensus.cc:697] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:11.628643  3493 raft_consensus.cc:2468] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:11.628639  3655 consensus_queue.cc:237] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.637006  3241 catalog_manager.cc:5697] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 2 to 3, leader changed from 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.672680  3662 raft_consensus.cc:993] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.673185  3653 raft_consensus.cc:1081] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:11.674613  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49392
I20260709 12:12:11.675119  3420 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:11.675379  3420 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:11.679958  3420 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.681469  3420 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 4 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:11.682317  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:11.682612  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:11.682909  3345 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:11.683178  3493 raft_consensus.cc:3055] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:11.683511  3493 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:11.684098  3493 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.684890  3493 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:11.687511  3345 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 4.
I20260709 12:12:11.688488  3387 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bb38e29d34846f98bf5a8548c92dd7d, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:11.689199  3493 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 4.
I20260709 12:12:11.689229  3655 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:11.689885  3655 raft_consensus.cc:697] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:11.690786  3655 consensus_queue.cc:237] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:11.697397  3241 catalog_manager.cc:5697] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 3 to 4, leader changed from 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.029577  3659 raft_consensus.cc:993] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:12.030071  3665 raft_consensus.cc:1081] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:12.031630  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ad1834656e42719c29e789305c6d59"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:12:12.032094  3420 raft_consensus.cc:493] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.032398  3420 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.036659  3420 raft_consensus.cc:515] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.038786  3420 leader_election.cc:290] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:12.039630  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:12.039919  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ad1834656e42719c29e789305c6d59" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:12.040163  3345 raft_consensus.cc:3055] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:12.040503  3493 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.040619  3345 raft_consensus.cc:740] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:12.041323  3345 consensus_queue.cc:260] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.042171  3345 raft_consensus.cc:3060] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.045045  3493 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:12.046156  3387 leader_election.cc:304] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:12.046487  3345 raft_consensus.cc:2468] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:12.046814  3655 raft_consensus.cc:2804] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:12.047272  3655 raft_consensus.cc:697] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:12.047956  3655 consensus_queue.cc:237] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.052799  3659 raft_consensus.cc:993] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: : Instructing follower dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:12.053356  3665 raft_consensus.cc:1081] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Signalling peer dc99371cc44742118d325bc1e75f2c88 to start an election
I20260709 12:12:12.054955  3420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
 from {username='slave'} at 127.0.0.1:49378
I20260709 12:12:12.055512  3420 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.055060  3241 catalog_manager.cc:5697] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 2 to 3, leader changed from 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.055948  3420 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.061214  3420 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.063021  3420 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:12.063902  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:12.064407  3345 raft_consensus.cc:3055] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:12.064425  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "dc99371cc44742118d325bc1e75f2c88" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:12.064826  3345 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:12.065179  3493 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.065549  3345 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.066385  3345 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.069913  3493 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:12.070493  3345 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc99371cc44742118d325bc1e75f2c88 in term 3.
I20260709 12:12:12.070969  3387 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, dc99371cc44742118d325bc1e75f2c88; no voters: 
I20260709 12:12:12.071735  3655 raft_consensus.cc:2804] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:12.072146  3655 raft_consensus.cc:697] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Becoming Leader. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:12.072867  3655 consensus_queue.cc:237] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:12.079505  3241 catalog_manager.cc:5697] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 reported cstate change: term changed from 2 to 3, leader changed from 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193) to dc99371cc44742118d325bc1e75f2c88 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "dc99371cc44742118d325bc1e75f2c88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.081907  3345 raft_consensus.cc:1275] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:12.083204  3655 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:12.093341  3493 raft_consensus.cc:1275] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:12.094552  3655 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:12.171063  3345 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:12.172467  3655 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:12.173834  3493 raft_consensus.cc:1275] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.175072  3655 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:12.179101  3345 raft_consensus.cc:1275] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.185638  3684 consensus_queue.cc:1048] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:12.192303  3493 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:12.194972  3685 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:12.454277  3345 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.455796  3666 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:12.465693  3493 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.467511  3666 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:12.583950  3346 raft_consensus.cc:1275] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.585235  3666 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:12.595137  3493 raft_consensus.cc:1275] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Refusing update from remote peer dc99371cc44742118d325bc1e75f2c88: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:12.596589  3666 consensus_queue.cc:1048] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:14.605551  3211 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:14.606792  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:14.616474  3420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:14.617388  3420 raft_consensus.cc:606] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:12:14.620682  3420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:14.621227  3420 raft_consensus.cc:606] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Received request to transfer leadership to TS 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:12:14.623921  3420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8357544c95e94921a033345960c24b44"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:14.624403  3420 raft_consensus.cc:606] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:12:14.626891  3420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:14.627362  3420 raft_consensus.cc:606] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 LEADER]: Received request to transfer leadership to TS 3e41a4247b314aa09d7917b2f2186c32
I20260709 12:12:14.629673  3420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163"
dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
mode: GRACEFUL
new_leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:49404
I20260709 12:12:14.630115  3420 raft_consensus.cc:606] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Received request to transfer leadership to TS 6bb38e29d34846f98bf5a8548c92dd7d
I20260709 12:12:14.631196  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:14.631718  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:14.661980  3685 raft_consensus.cc:993] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:14.662684  3694 raft_consensus.cc:1081] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Signalling peer 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:14.664397  3493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:35200
I20260709 12:12:14.664847  3493 raft_consensus.cc:493] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.665138  3493 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:14.670012  3493 raft_consensus.cc:515] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.672101  3493 leader_election.cc:290] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 4 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:12:14.673374  3346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:14.673274  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548d35ecc1bc4cc7acd530b660776d6c" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:14.674153  3346 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:14.674211  3420 raft_consensus.cc:3055] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:14.674623  3420 raft_consensus.cc:740] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:14.675669  3420 consensus_queue.cc:260] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.677076  3420 raft_consensus.cc:3060] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:14.681552  3346 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 4.
I20260709 12:12:14.682916  3461 leader_election.cc:304] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:14.683667  3420 raft_consensus.cc:2468] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 4.
I20260709 12:12:14.683794  3653 raft_consensus.cc:2804] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:14.684999  3653 raft_consensus.cc:697] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 4 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:14.685662  3653 consensus_queue.cc:237] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.692744  3242 catalog_manager.cc:5697] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 3 to 4, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.855257  3685 raft_consensus.cc:993] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.855729  3685 raft_consensus.cc:1081] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.857300  3346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8357544c95e94921a033345960c24b44"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:12:14.857817  3346 raft_consensus.cc:493] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.858107  3346 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:14.862033  3346 raft_consensus.cc:515] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.863940  3346 leader_election.cc:290] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Requested vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:14.864876  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:14.865134  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8357544c95e94921a033345960c24b44" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:14.865420  3420 raft_consensus.cc:3055] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:14.865624  3493 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:14.865775  3420 raft_consensus.cc:740] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:14.866539  3420 consensus_queue.cc:260] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.867720  3420 raft_consensus.cc:3060] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:14.871644  3493 raft_consensus.cc:2468] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:12:14.873030  3312 leader_election.cc:304] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:14.873291  3420 raft_consensus.cc:2468] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 2.
I20260709 12:12:14.874758  3701 raft_consensus.cc:2804] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:14.875790  3701 raft_consensus.cc:697] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:14.876632  3701 consensus_queue.cc:237] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.883371  3242 catalog_manager.cc:5697] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 1 to 2, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.909401  3694 raft_consensus.cc:993] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.909865  3685 raft_consensus.cc:1081] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.911336  3346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:12:14.911813  3346 raft_consensus.cc:493] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.912048  3346 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.916088  3346 raft_consensus.cc:515] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:14.917621  3346 leader_election.cc:290] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 3 election: Requested vote from peers 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:12:14.918468  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:14.918686  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db0d9af34f2d452f8fffa06d1f28b163" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:14.918972  3493 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.919310  3420 raft_consensus.cc:3055] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:14.919585  3420 raft_consensus.cc:740] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:14.920296  3420 consensus_queue.cc:260] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:14.921167  3420 raft_consensus.cc:3060] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.923702  3493 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 3.
I20260709 12:12:14.924701  3312 leader_election.cc:304] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:14.925422  3701 raft_consensus.cc:2804] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:14.925715  3420 raft_consensus.cc:2468] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 3.
I20260709 12:12:14.925951  3701 raft_consensus.cc:697] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:14.926932  3701 consensus_queue.cc:237] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } }
I20260709 12:12:14.934235  3242 catalog_manager.cc:5697] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 2 to 3, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.936973  3694 raft_consensus.cc:993] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.937459  3685 raft_consensus.cc:1081] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Signalling peer 6bb38e29d34846f98bf5a8548c92dd7d to start an election
I20260709 12:12:14.939172  3346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde"
dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:12:14.939602  3346 raft_consensus.cc:493] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:14.939903  3346 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.944702  3346 raft_consensus.cc:515] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.946323  3346 leader_election.cc:290] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 3 election: Requested vote from peers dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229), 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195:35795)
I20260709 12:12:14.947023  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:14.947659  3493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d56bfff00b4f1cb82ea7202333dbde" candidate_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
I20260709 12:12:14.947880  3420 raft_consensus.cc:3055] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:14.948186  3420 raft_consensus.cc:740] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:14.948199  3493 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.949080  3420 consensus_queue.cc:260] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.950183  3420 raft_consensus.cc:3060] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.954531  3493 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 3.
I20260709 12:12:14.955808  3312 leader_election.cc:304] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:14.956197  3420 raft_consensus.cc:2468] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bb38e29d34846f98bf5a8548c92dd7d in term 3.
I20260709 12:12:14.956707  3701 raft_consensus.cc:2804] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:14.957199  3701 raft_consensus.cc:697] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 LEADER]: Becoming Leader. State: Replica: 6bb38e29d34846f98bf5a8548c92dd7d, State: Running, Role: LEADER
I20260709 12:12:14.957959  3701 consensus_queue.cc:237] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:14.965252  3242 catalog_manager.cc:5697] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d reported cstate change: term changed from 2 to 3, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.084550  3694 raft_consensus.cc:993] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: : Instructing follower 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:15.085000  3685 raft_consensus.cc:1081] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 LEADER]: Signalling peer 3e41a4247b314aa09d7917b2f2186c32 to start an election
I20260709 12:12:15.086352  3493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fa99770647b414da871053c87e2801d"
dest_uuid: "3e41a4247b314aa09d7917b2f2186c32"
 from {username='slave'} at 127.0.0.1:35200
I20260709 12:12:15.086807  3493 raft_consensus.cc:493] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:15.087117  3493 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:15.091234  3493 raft_consensus.cc:515] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:15.092656  3493 leader_election.cc:290] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 5 election: Requested vote from peers 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495), dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229)
I20260709 12:12:15.093776  3345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6bb38e29d34846f98bf5a8548c92dd7d"
I20260709 12:12:15.093870  3420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa99770647b414da871053c87e2801d" candidate_uuid: "3e41a4247b314aa09d7917b2f2186c32" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "dc99371cc44742118d325bc1e75f2c88"
I20260709 12:12:15.094256  3345 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:15.094406  3420 raft_consensus.cc:3055] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:15.094754  3420 raft_consensus.cc:740] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dc99371cc44742118d325bc1e75f2c88, State: Running, Role: LEADER
I20260709 12:12:15.095480  3420 consensus_queue.cc:260] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:15.096338  3420 raft_consensus.cc:3060] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:15.098755  3345 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 5.
I20260709 12:12:15.099758  3461 leader_election.cc:304] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e41a4247b314aa09d7917b2f2186c32, 6bb38e29d34846f98bf5a8548c92dd7d; no voters: 
I20260709 12:12:15.100243  3420 raft_consensus.cc:2468] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e41a4247b314aa09d7917b2f2186c32 in term 5.
I20260709 12:12:15.100389  3653 raft_consensus.cc:2804] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:15.100821  3653 raft_consensus.cc:697] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 5 LEADER]: Becoming Leader. State: Replica: 3e41a4247b314aa09d7917b2f2186c32, State: Running, Role: LEADER
I20260709 12:12:15.101588  3653 consensus_queue.cc:237] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } }
I20260709 12:12:15.108502  3242 catalog_manager.cc:5697] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 reported cstate change: term changed from 4 to 5, leader changed from dc99371cc44742118d325bc1e75f2c88 (127.3.34.194) to 3e41a4247b314aa09d7917b2f2186c32 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "3e41a4247b314aa09d7917b2f2186c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.211325  3420 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:15.212723  3653 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:15.222857  3345 raft_consensus.cc:1275] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:15.224278  3653 consensus_queue.cc:1048] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:15.266729  3493 raft_consensus.cc:1275] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:15.267956  3701 consensus_queue.cc:1048] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:15.277385  3420 raft_consensus.cc:1275] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:15.279764  3701 consensus_queue.cc:1048] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:15.342618  3493 raft_consensus.cc:1275] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:15.343861  3701 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:15.353729  3420 raft_consensus.cc:1275] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:15.355542  3701 consensus_queue.cc:1048] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:15.456945  3493 raft_consensus.cc:1275] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:15.458192  3701 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e41a4247b314aa09d7917b2f2186c32" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:15.468298  3420 raft_consensus.cc:1275] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Refusing update from remote peer 6bb38e29d34846f98bf5a8548c92dd7d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:15.469986  3701 consensus_queue.cc:1048] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:15.632900  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:15.640601  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:15.641167  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:15.694079  3345 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 5 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:15.695284  3710 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bb38e29d34846f98bf5a8548c92dd7d" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:15.704080  3420 raft_consensus.cc:1275] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 5 FOLLOWER]: Refusing update from remote peer 3e41a4247b314aa09d7917b2f2186c32: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:15.705883  3695 consensus_queue.cc:1048] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc99371cc44742118d325bc1e75f2c88" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:16.642191  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:16.647408  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:16.647848  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:17.648936  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.654297  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:17.654744  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:18.655930  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:18.661334  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:18.661839  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:19.663026  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:19.668133  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:19.668582  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:20.669798  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:20.675185  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:20.675697  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:21.676740  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.681785  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:21.682235  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:22.683414  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.689505  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:22.689934  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:23.691265  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.697048  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:23.697476  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:24.731576  3211 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:24.732241  3211 tablet_server.cc:179] TabletServer@127.3.34.193:0 shutting down...
I20260709 12:12:24.763132  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:24.764796  3211 tablet_replica.cc:333] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.765982  3211 raft_consensus.cc:2243] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.767287  3211 raft_consensus.cc:2272] T 8357544c95e94921a033345960c24b44 P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.769531  3211 tablet_replica.cc:333] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.770038  3211 raft_consensus.cc:2243] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.770469  3211 raft_consensus.cc:2272] T 88a5b18d134e49d78a2e60d482dc7638 P 6bb38e29d34846f98bf5a8548c92dd7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.772279  3211 tablet_replica.cc:333] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.772799  3211 raft_consensus.cc:2243] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.773699  3211 raft_consensus.cc:2272] T 26d56bfff00b4f1cb82ea7202333dbde P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.775530  3211 tablet_replica.cc:333] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.776036  3211 raft_consensus.cc:2243] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.776495  3211 raft_consensus.cc:2272] T 02ad1834656e42719c29e789305c6d59 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.778252  3211 tablet_replica.cc:333] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.778760  3211 raft_consensus.cc:2243] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.779623  3211 raft_consensus.cc:2272] T db0d9af34f2d452f8fffa06d1f28b163 P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.781250  3211 tablet_replica.cc:333] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.781788  3211 raft_consensus.cc:2243] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.782219  3211 raft_consensus.cc:2272] T 3ce30e4a66534c948f64b15993ba3ead P 6bb38e29d34846f98bf5a8548c92dd7d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.784044  3211 tablet_replica.cc:333] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.784531  3211 raft_consensus.cc:2243] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.784994  3211 raft_consensus.cc:2272] T 9fa99770647b414da871053c87e2801d P 6bb38e29d34846f98bf5a8548c92dd7d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.787125  3211 tablet_replica.cc:333] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.787667  3211 raft_consensus.cc:2243] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.788128  3211 raft_consensus.cc:2272] T 548d35ecc1bc4cc7acd530b660776d6c P 6bb38e29d34846f98bf5a8548c92dd7d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.789779  3211 tablet_replica.cc:333] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d: stopping tablet replica
I20260709 12:12:24.790246  3211 raft_consensus.cc:2243] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.790697  3211 raft_consensus.cc:2272] T 32f12414843040469cd7c77fa2e70fca P 6bb38e29d34846f98bf5a8548c92dd7d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.878547  3211 tablet_server.cc:196] TabletServer@127.3.34.193:0 shutdown complete.
I20260709 12:12:24.899511  3211 tablet_server.cc:179] TabletServer@127.3.34.194:0 shutting down...
W20260709 12:12:24.905248  3461 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:24.914476  3461 consensus_peers.cc:597] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 -> Peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Couldn't send request to peer dc99371cc44742118d325bc1e75f2c88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.934463  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:24.935292  3211 tablet_replica.cc:333] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.936126  3211 raft_consensus.cc:2243] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.936748  3211 raft_consensus.cc:2272] T 26d56bfff00b4f1cb82ea7202333dbde P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.938679  3211 tablet_replica.cc:333] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.939263  3211 raft_consensus.cc:2243] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.939739  3211 raft_consensus.cc:2272] T 548d35ecc1bc4cc7acd530b660776d6c P dc99371cc44742118d325bc1e75f2c88 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.941396  3211 tablet_replica.cc:333] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.941939  3211 raft_consensus.cc:2243] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.942355  3211 raft_consensus.cc:2272] T 88a5b18d134e49d78a2e60d482dc7638 P dc99371cc44742118d325bc1e75f2c88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.944109  3211 tablet_replica.cc:333] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.944614  3211 raft_consensus.cc:2243] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.945776  3211 raft_consensus.cc:2272] T 32f12414843040469cd7c77fa2e70fca P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.947510  3211 tablet_replica.cc:333] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.948130  3211 raft_consensus.cc:2243] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.948791  3211 raft_consensus.cc:2272] T 8357544c95e94921a033345960c24b44 P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.950881  3211 tablet_replica.cc:333] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.951491  3211 raft_consensus.cc:2243] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.952080  3211 raft_consensus.cc:2272] T 9fa99770647b414da871053c87e2801d P dc99371cc44742118d325bc1e75f2c88 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.954634  3211 tablet_replica.cc:333] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
W20260709 12:12:24.954674  3461 consensus_peers.cc:597] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 -> Peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Couldn't send request to peer 6bb38e29d34846f98bf5a8548c92dd7d. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:36495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.955279  3211 raft_consensus.cc:2243] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.956111  3211 raft_consensus.cc:2272] T 3ce30e4a66534c948f64b15993ba3ead P dc99371cc44742118d325bc1e75f2c88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.957793  3211 tablet_replica.cc:333] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.958266  3211 raft_consensus.cc:2243] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:24.958714  3211 raft_consensus.cc:2272] T db0d9af34f2d452f8fffa06d1f28b163 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.960366  3211 tablet_replica.cc:333] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88: stopping tablet replica
I20260709 12:12:24.960819  3211 raft_consensus.cc:2243] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.961627  3211 raft_consensus.cc:2272] T 02ad1834656e42719c29e789305c6d59 P dc99371cc44742118d325bc1e75f2c88 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:24.969702  3461 consensus_peers.cc:597] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 -> Peer dc99371cc44742118d325bc1e75f2c88 (127.3.34.194:43229): Couldn't send request to peer dc99371cc44742118d325bc1e75f2c88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.990563  3211 tablet_server.cc:196] TabletServer@127.3.34.194:0 shutdown complete.
I20260709 12:12:25.009567  3211 tablet_server.cc:179] TabletServer@127.3.34.195:0 shutting down...
W20260709 12:12:25.034901  3461 consensus_peers.cc:597] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 -> Peer 6bb38e29d34846f98bf5a8548c92dd7d (127.3.34.193:36495): Couldn't send request to peer 6bb38e29d34846f98bf5a8548c92dd7d. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:36495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.037498  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:25.038416  3211 tablet_replica.cc:333] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.039433  3211 raft_consensus.cc:2243] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.040095  3211 raft_consensus.cc:2272] T 32f12414843040469cd7c77fa2e70fca P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.041893  3211 tablet_replica.cc:333] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.042373  3211 raft_consensus.cc:2243] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.043236  3211 raft_consensus.cc:2272] T 548d35ecc1bc4cc7acd530b660776d6c P 3e41a4247b314aa09d7917b2f2186c32 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.044895  3211 tablet_replica.cc:333] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.045406  3211 raft_consensus.cc:2243] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.046173  3211 raft_consensus.cc:2272] T 9fa99770647b414da871053c87e2801d P 3e41a4247b314aa09d7917b2f2186c32 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.047899  3211 tablet_replica.cc:333] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.048503  3211 raft_consensus.cc:2243] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.048970  3211 raft_consensus.cc:2272] T 8357544c95e94921a033345960c24b44 P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.050647  3211 tablet_replica.cc:333] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.051278  3211 raft_consensus.cc:2243] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.051748  3211 raft_consensus.cc:2272] T db0d9af34f2d452f8fffa06d1f28b163 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.053494  3211 tablet_replica.cc:333] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.053959  3211 raft_consensus.cc:2243] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.054433  3211 raft_consensus.cc:2272] T 3ce30e4a66534c948f64b15993ba3ead P 3e41a4247b314aa09d7917b2f2186c32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.056079  3211 tablet_replica.cc:333] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.056576  3211 raft_consensus.cc:2243] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.056990  3211 raft_consensus.cc:2272] T 02ad1834656e42719c29e789305c6d59 P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.058607  3211 tablet_replica.cc:333] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.059175  3211 raft_consensus.cc:2243] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:25.059646  3211 raft_consensus.cc:2272] T 26d56bfff00b4f1cb82ea7202333dbde P 3e41a4247b314aa09d7917b2f2186c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.061285  3211 tablet_replica.cc:333] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32: stopping tablet replica
I20260709 12:12:25.061718  3211 raft_consensus.cc:2243] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.062479  3211 raft_consensus.cc:2272] T 88a5b18d134e49d78a2e60d482dc7638 P 3e41a4247b314aa09d7917b2f2186c32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.089740  3211 tablet_server.cc:196] TabletServer@127.3.34.195:0 shutdown complete.
I20260709 12:12:25.108071  3211 master.cc:562] Master@127.3.34.254:43721 shutting down...
I20260709 12:12:25.234180  3211 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:25.234882  3211 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:25.235227  3211 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6eae6bfe4e9840c595b5d74a9556413c: stopping tablet replica
I20260709 12:12:25.255602  3211 master.cc:584] Master@127.3.34.254:43721 shutdown complete.
3e41a4247b314aa09d7917b2f2186c32  1
6bb38e29d34846f98bf5a8548c92dd7d  4
dc99371cc44742118d325bc1e75f2c88  4
3e41a4247b314aa09d7917b2f2186c32  3
6bb38e29d34846f98bf5a8548c92dd7d  3
dc99371cc44742118d325bc1e75f2c88  3
3e41a4247b314aa09d7917b2f2186c32  1
6bb38e29d34846f98bf5a8548c92dd7d  0
dc99371cc44742118d325bc1e75f2c88  8
3e41a4247b314aa09d7917b2f2186c32  3
6bb38e29d34846f98bf5a8548c92dd7d  3
dc99371cc44742118d325bc1e75f2c88  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30983 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:25.297488  3211 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.34.254:34671
I20260709 12:12:25.298615  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.304497  3733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.305035  3732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.306429  3211 server_base.cc:1061] running on GCE node
W20260709 12:12:25.306710  3735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.307624  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.307816  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.308007  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599145307973 us; error 0 us; skew 500 ppm
I20260709 12:12:25.308598  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.311097  3211 webserver.cc:533] Webserver started at http://127.3.34.254:43935/ using document root <none> and password file <none>
I20260709 12:12:25.311579  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.311794  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.312070  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.313212  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/master-0-root/instance:
uuid: "c965a98e1f764b1bb253c141f4dd7b74"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.317797  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:12:25.321229  3740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.322012  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:12:25.322345  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/master-0-root
uuid: "c965a98e1f764b1bb253c141f4dd7b74"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.322691  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.355082  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.356334  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.395969  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.254:34671
I20260709 12:12:25.396077  3791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.254:34671 every 8 connection(s)
I20260709 12:12:25.400053  3792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.409639  3792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74: Bootstrap starting.
I20260709 12:12:25.414294  3792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.418781  3792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74: No bootstrap required, opened a new log
I20260709 12:12:25.421139  3792 raft_consensus.cc:359] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER }
I20260709 12:12:25.421595  3792 raft_consensus.cc:385] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:25.421890  3792 raft_consensus.cc:740] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c965a98e1f764b1bb253c141f4dd7b74, State: Initialized, Role: FOLLOWER
I20260709 12:12:25.422549  3792 consensus_queue.cc:260] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER }
I20260709 12:12:25.423045  3792 raft_consensus.cc:399] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:25.423301  3792 raft_consensus.cc:493] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:25.423552  3792 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:25.428344  3792 raft_consensus.cc:515] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER }
I20260709 12:12:25.428925  3792 leader_election.cc:304] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c965a98e1f764b1bb253c141f4dd7b74; no voters: 
I20260709 12:12:25.430053  3792 leader_election.cc:290] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:25.430471  3795 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:25.432284  3795 raft_consensus.cc:697] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 1 LEADER]: Becoming Leader. State: Replica: c965a98e1f764b1bb253c141f4dd7b74, State: Running, Role: LEADER
I20260709 12:12:25.433162  3792 sys_catalog.cc:565] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:25.433223  3795 consensus_queue.cc:237] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER }
I20260709 12:12:25.439354  3796 sys_catalog.cc:455] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c965a98e1f764b1bb253c141f4dd7b74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER } }
I20260709 12:12:25.440171  3796 sys_catalog.cc:458] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:25.441002  3797 sys_catalog.cc:455] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c965a98e1f764b1bb253c141f4dd7b74. Latest consensus state: current_term: 1 leader_uuid: "c965a98e1f764b1bb253c141f4dd7b74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c965a98e1f764b1bb253c141f4dd7b74" member_type: VOTER } }
I20260709 12:12:25.441550  3797 sys_catalog.cc:458] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:25.442580  3802 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:25.448453  3802 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:25.452657  3211 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:25.458792  3802 catalog_manager.cc:1383] Generated new cluster ID: 7ac3a503894e4516b5c68fe11794a858
I20260709 12:12:25.459152  3802 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:25.472862  3802 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:25.474143  3802 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:25.490236  3802 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74: Generated new TSK 0
I20260709 12:12:25.490870  3802 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:25.520231  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.527107  3813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.527731  3814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.529206  3816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.530000  3211 server_base.cc:1061] running on GCE node
I20260709 12:12:25.531262  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.531539  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.531679  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599145531664 us; error 0 us; skew 500 ppm
I20260709 12:12:25.532214  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.534523  3211 webserver.cc:533] Webserver started at http://127.3.34.193:37809/ using document root <none> and password file <none>
I20260709 12:12:25.535148  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.535324  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.535549  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.536585  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-0-root/instance:
uuid: "1ba47a6932f54687bb742b0d0244f158"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.541440  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:25.544957  3821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.546064  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:12:25.546648  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
uuid: "1ba47a6932f54687bb742b0d0244f158"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.547109  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.575374  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.576781  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.578502  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.581166  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.581419  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.581707  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.581912  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.625411  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.193:36319
I20260709 12:12:25.625495  3883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.193:36319 every 8 connection(s)
I20260709 12:12:25.630434  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.637579  3888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.638247  3889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.640555  3891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.641340  3211 server_base.cc:1061] running on GCE node
I20260709 12:12:25.642681  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.642867  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.643112  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599145643096 us; error 0 us; skew 500 ppm
I20260709 12:12:25.643719  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.646647  3211 webserver.cc:533] Webserver started at http://127.3.34.194:46489/ using document root <none> and password file <none>
I20260709 12:12:25.647342  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.647610  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.648029  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.648703  3884 heartbeater.cc:344] Connected to a master server at 127.3.34.254:34671
I20260709 12:12:25.649120  3884 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.649428  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-1-root/instance:
uuid: "08e845ab2acb48ac94212e039371b50f"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.650030  3884 heartbeater.cc:507] Master 127.3.34.254:34671 requested a full tablet report, sending...
I20260709 12:12:25.652236  3757 ts_manager.cc:194] Registered new tserver with Master: 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319)
I20260709 12:12:25.654333  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41614
I20260709 12:12:25.654560  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:12:25.658202  3896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.659057  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:25.659381  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
uuid: "08e845ab2acb48ac94212e039371b50f"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.659737  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.692422  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.693660  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.695145  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.697353  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.697584  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.697836  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.698009  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.740744  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.194:43611
I20260709 12:12:25.740867  3958 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.194:43611 every 8 connection(s)
I20260709 12:12:25.745642  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.753185  3962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.755240  3963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.757745  3211 server_base.cc:1061] running on GCE node
W20260709 12:12:25.759380  3965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.760206  3959 heartbeater.cc:344] Connected to a master server at 127.3.34.254:34671
I20260709 12:12:25.760607  3959 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.760656  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.761077  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.761314  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599145761294 us; error 0 us; skew 500 ppm
I20260709 12:12:25.761636  3959 heartbeater.cc:507] Master 127.3.34.254:34671 requested a full tablet report, sending...
I20260709 12:12:25.762171  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.764149  3757 ts_manager.cc:194] Registered new tserver with Master: 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:25.765542  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41624
I20260709 12:12:25.769327  3211 webserver.cc:533] Webserver started at http://127.3.34.195:37565/ using document root <none> and password file <none>
I20260709 12:12:25.770089  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.770354  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.770695  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.772388  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-2-root/instance:
uuid: "158279150a30440080e9b1d0732c4bb2"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.778750  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:12:25.783309  3970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.784240  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:12:25.784626  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
uuid: "158279150a30440080e9b1d0732c4bb2"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-x5d7"
I20260709 12:12:25.785028  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599114140998-3211-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.817142  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.818358  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.820017  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.822212  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.822448  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.822702  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.822934  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.871958  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.195:36193
I20260709 12:12:25.872040  4032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.195:36193 every 8 connection(s)
I20260709 12:12:25.886319  4033 heartbeater.cc:344] Connected to a master server at 127.3.34.254:34671
I20260709 12:12:25.886838  4033 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.887714  4033 heartbeater.cc:507] Master 127.3.34.254:34671 requested a full tablet report, sending...
I20260709 12:12:25.889662  3757 ts_manager.cc:194] Registered new tserver with Master: 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:25.890105  3211 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014943793s
I20260709 12:12:25.891477  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41636
I20260709 12:12:25.917519  3757 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:25.921020  3757 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:26.002461  3924 tablet_service.cc:1511] Processing CreateTablet for tablet bb643afb0f5a463882f7ac1c4f7401db (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:26.003924  3924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb643afb0f5a463882f7ac1c4f7401db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.005076  3920 tablet_service.cc:1511] Processing CreateTablet for tablet c44fb5a6e2c64f81ace469ffb82dcde2 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:26.006618  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44fb5a6e2c64f81ace469ffb82dcde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.008065  3921 tablet_service.cc:1511] Processing CreateTablet for tablet 914a5c12f9d84f7b878d039fcc69beda (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:26.009518  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914a5c12f9d84f7b878d039fcc69beda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.012107  3922 tablet_service.cc:1511] Processing CreateTablet for tablet d419a53f57ce43f88240c3695e093c02 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:26.013504  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d419a53f57ce43f88240c3695e093c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.014652  3849 tablet_service.cc:1511] Processing CreateTablet for tablet bb643afb0f5a463882f7ac1c4f7401db (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:26.016355  3923 tablet_service.cc:1511] Processing CreateTablet for tablet 322db566acfc49c4912c354f77dcb761 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:26.016671  3848 tablet_service.cc:1511] Processing CreateTablet for tablet 322db566acfc49c4912c354f77dcb761 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:26.017469  3842 tablet_service.cc:1511] Processing CreateTablet for tablet a27677e6e2f640358d54d385645cf728 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:26.018023  3923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322db566acfc49c4912c354f77dcb761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.019454  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 559794ebd31f44e3b873b912b95596f1 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:26.019467  3841 tablet_service.cc:1511] Processing CreateTablet for tablet c051edc6de6d41bab39cac834f5ea2a5 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:26.021852  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:26.024221  3845 tablet_service.cc:1511] Processing CreateTablet for tablet c44fb5a6e2c64f81ace469ffb82dcde2 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:26.026484  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 914a5c12f9d84f7b878d039fcc69beda (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:26.026865  3840 tablet_service.cc:1511] Processing CreateTablet for tablet d85445c1fda1442a9d0882530345a1a3 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:26.028766  3847 tablet_service.cc:1511] Processing CreateTablet for tablet d419a53f57ce43f88240c3695e093c02 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:26.032815  3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb643afb0f5a463882f7ac1c4f7401db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.037530  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559794ebd31f44e3b873b912b95596f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.047106  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85445c1fda1442a9d0882530345a1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.047755  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.050933  3919 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:26.051638  3918 tablet_service.cc:1511] Processing CreateTablet for tablet 559794ebd31f44e3b873b912b95596f1 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:26.052552  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.053282  3918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559794ebd31f44e3b873b912b95596f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.048941  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44fb5a6e2c64f81ace469ffb82dcde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.054306  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322db566acfc49c4912c354f77dcb761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.055691  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051edc6de6d41bab39cac834f5ea2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.057557  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914a5c12f9d84f7b878d039fcc69beda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.059262  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27677e6e2f640358d54d385645cf728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.060868  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d419a53f57ce43f88240c3695e093c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.060902  3915 tablet_service.cc:1511] Processing CreateTablet for tablet d85445c1fda1442a9d0882530345a1a3 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:26.062322  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85445c1fda1442a9d0882530345a1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.059113  3916 tablet_service.cc:1511] Processing CreateTablet for tablet c051edc6de6d41bab39cac834f5ea2a5 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:26.065016  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051edc6de6d41bab39cac834f5ea2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.057138  3917 tablet_service.cc:1511] Processing CreateTablet for tablet a27677e6e2f640358d54d385645cf728 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:26.068351  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27677e6e2f640358d54d385645cf728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.088927  3998 tablet_service.cc:1511] Processing CreateTablet for tablet bb643afb0f5a463882f7ac1c4f7401db (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:26.090448  3998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb643afb0f5a463882f7ac1c4f7401db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.094319  4048 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.095592  3996 tablet_service.cc:1511] Processing CreateTablet for tablet d419a53f57ce43f88240c3695e093c02 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:26.097007  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d419a53f57ce43f88240c3695e093c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.100315  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 914a5c12f9d84f7b878d039fcc69beda (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:26.101718  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914a5c12f9d84f7b878d039fcc69beda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.104269  3994 tablet_service.cc:1511] Processing CreateTablet for tablet c44fb5a6e2c64f81ace469ffb82dcde2 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:26.106561  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:26.109093  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 559794ebd31f44e3b873b912b95596f1 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:26.111809  3991 tablet_service.cc:1511] Processing CreateTablet for tablet a27677e6e2f640358d54d385645cf728 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:26.094352  3997 tablet_service.cc:1511] Processing CreateTablet for tablet 322db566acfc49c4912c354f77dcb761 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:26.116387  3997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 322db566acfc49c4912c354f77dcb761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.118044  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27677e6e2f640358d54d385645cf728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.119577  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44fb5a6e2c64f81ace469ffb82dcde2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.121061  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2f42cfa4a04ae88b4b155cc1c6adc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.122480  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559794ebd31f44e3b873b912b95596f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.145599  4049 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.145660  3990 tablet_service.cc:1511] Processing CreateTablet for tablet c051edc6de6d41bab39cac834f5ea2a5 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:26.152957  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051edc6de6d41bab39cac834f5ea2a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.160131  3989 tablet_service.cc:1511] Processing CreateTablet for tablet d85445c1fda1442a9d0882530345a1a3 (DEFAULT_TABLE table=test-workload [id=62e138a7c1b74646a145846394a5b481]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:26.168063  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85445c1fda1442a9d0882530345a1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.178357  4048 tablet_bootstrap.cc:654] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.181492  4049 tablet_bootstrap.cc:654] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.206907  4050 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.229681  4050 tablet_bootstrap.cc:654] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.250244  4048 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.250886  4048 ts_tablet_manager.cc:1403] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.010s
I20260709 12:12:26.254215  4048 raft_consensus.cc:359] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.255110  4048 raft_consensus.cc:385] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.255517  4048 raft_consensus.cc:740] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.256527  4048 consensus_queue.cc:260] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.258430  4049 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.258925  4049 ts_tablet_manager.cc:1403] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.016s
I20260709 12:12:26.264943  4049 raft_consensus.cc:359] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.265726  4049 raft_consensus.cc:385] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.266023  4049 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.266717  4049 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.267840  4050 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.268447  4050 ts_tablet_manager.cc:1403] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.005s
I20260709 12:12:26.270622  3884 heartbeater.cc:499] Master 127.3.34.254:34671 was elected leader, sending a full tablet report...
I20260709 12:12:26.271180  4049 ts_tablet_manager.cc:1434] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:12:26.272131  4049 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.272378  4050 raft_consensus.cc:359] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.273356  4050 raft_consensus.cc:385] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.273742  4050 raft_consensus.cc:740] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.275249  4050 consensus_queue.cc:260] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.277787  3959 heartbeater.cc:499] Master 127.3.34.254:34671 was elected leader, sending a full tablet report...
I20260709 12:12:26.277872  4033 heartbeater.cc:499] Master 127.3.34.254:34671 was elected leader, sending a full tablet report...
I20260709 12:12:26.278152  4049 tablet_bootstrap.cc:654] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.286811  4050 ts_tablet_manager.cc:1434] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:12:26.288074  4050 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.288945  4048 ts_tablet_manager.cc:1434] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.013s
I20260709 12:12:26.290396  4048 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.294746  4050 tablet_bootstrap.cc:654] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.299026  4048 tablet_bootstrap.cc:654] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.302250  4049 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.302757  4049 ts_tablet_manager.cc:1403] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.019s
I20260709 12:12:26.306442  4049 raft_consensus.cc:359] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.307437  4049 raft_consensus.cc:385] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.307819  4049 raft_consensus.cc:740] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.309000  4049 consensus_queue.cc:260] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.312170  4049 ts_tablet_manager.cc:1434] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:26.313409  4049 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.322310  4049 tablet_bootstrap.cc:654] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.371063  4048 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.371624  4048 ts_tablet_manager.cc:1403] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.082s	user 0.029s	sys 0.049s
I20260709 12:12:26.372301  4049 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.372308  4050 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.372888  4049 ts_tablet_manager.cc:1403] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.032s
I20260709 12:12:26.373003  4050 ts_tablet_manager.cc:1403] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.085s	user 0.040s	sys 0.039s
I20260709 12:12:26.374855  4048 raft_consensus.cc:359] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.375674  4048 raft_consensus.cc:385] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.375999  4048 raft_consensus.cc:740] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.375836  4050 raft_consensus.cc:359] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.376636  4050 raft_consensus.cc:385] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.376230  4049 raft_consensus.cc:359] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.376928  4050 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.377135  4049 raft_consensus.cc:385] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.377540  4049 raft_consensus.cc:740] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.376912  4048 consensus_queue.cc:260] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.377904  4050 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.378261  4049 consensus_queue.cc:260] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.379508  4048 ts_tablet_manager.cc:1434] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:26.380513  4048 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.381896  4050 ts_tablet_manager.cc:1434] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:26.382294  4049 ts_tablet_manager.cc:1434] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:26.382790  4050 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.383234  4049 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.389602  4048 tablet_bootstrap.cc:654] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.389602  4049 tablet_bootstrap.cc:654] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.389662  4050 tablet_bootstrap.cc:654] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.401441  4049 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.402112  4049 ts_tablet_manager.cc:1403] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 12:12:26.405918  4049 raft_consensus.cc:359] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.406915  4049 raft_consensus.cc:385] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.408540  4049 raft_consensus.cc:740] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.409485  4049 consensus_queue.cc:260] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.409857  4055 raft_consensus.cc:493] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.410230  4050 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.410771  4050 ts_tablet_manager.cc:1403] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.007s
I20260709 12:12:26.410593  4055 raft_consensus.cc:515] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.414649  4050 raft_consensus.cc:359] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.415654  4050 raft_consensus.cc:385] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.416040  4050 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.417362  4050 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.417798  4055 leader_election.cc:290] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.419852  4050 ts_tablet_manager.cc:1434] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:26.420253  4049 ts_tablet_manager.cc:1434] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:12:26.420957  4050 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.421237  4049 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.427577  4049 tablet_bootstrap.cc:654] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.427577  4050 tablet_bootstrap.cc:654] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.440807  4049 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.440805  4050 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.441516  4049 ts_tablet_manager.cc:1403] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:12:26.441520  4050 ts_tablet_manager.cc:1403] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:12:26.444759  4050 raft_consensus.cc:359] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.445649  4050 raft_consensus.cc:385] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.446007  4050 raft_consensus.cc:740] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
W20260709 12:12:26.447338  3805 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:26.447135  4050 consensus_queue.cc:260] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.447917  4056 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.448374  4056 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.454098  4056 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319)
I20260709 12:12:26.444891  4049 raft_consensus.cc:359] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.470140  4049 raft_consensus.cc:385] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.470595  4049 raft_consensus.cc:740] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.471660  4049 consensus_queue.cc:260] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.474320  4049 ts_tablet_manager.cc:1434] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:12:26.479004  4064 raft_consensus.cc:493] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.479710  4064 raft_consensus.cc:515] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.483623  4064 leader_election.cc:290] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.487478  4049 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.505662  4049 tablet_bootstrap.cc:654] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.528795  4049 tablet_bootstrap.cc:492] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.529450  4049 ts_tablet_manager.cc:1403] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 12:12:26.533319  4049 raft_consensus.cc:359] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.534332  4049 raft_consensus.cc:385] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.534726  4049 raft_consensus.cc:740] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.536123  4049 consensus_queue.cc:260] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.542074  4049 ts_tablet_manager.cc:1434] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:26.543100  4050 ts_tablet_manager.cc:1434] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.101s	user 0.043s	sys 0.053s
I20260709 12:12:26.543177  4049 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.544108  4064 raft_consensus.cc:493] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.544574  4064 raft_consensus.cc:515] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.545432  4048 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.545970  4048 ts_tablet_manager.cc:1403] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.166s	user 0.041s	sys 0.107s
I20260709 12:12:26.546149  4050 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.546759  4064 leader_election.cc:290] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.548724  4054 raft_consensus.cc:493] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.549314  4054 raft_consensus.cc:515] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.549808  4048 raft_consensus.cc:359] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.550611  4048 raft_consensus.cc:385] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.550941  4048 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.551946  4048 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.553869  4050 tablet_bootstrap.cc:654] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.554401  4049 tablet_bootstrap.cc:654] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.560683  3933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.562734  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d419a53f57ce43f88240c3695e093c02" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.563678  3932 raft_consensus.cc:2468] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:26.563571  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.564656  3934 raft_consensus.cc:2468] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:26.573992  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
W20260709 12:12:26.574306  3823 leader_election.cc:343] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.576340  3823 leader_election.cc:304] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:26.577569  4064 raft_consensus.cc:2804] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.577732  3823 leader_election.cc:304] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:26.578095  4064 raft_consensus.cc:493] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.578660  4064 raft_consensus.cc:3060] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.578896  4055 raft_consensus.cc:2804] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.579443  4055 raft_consensus.cc:493] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.579841  4055 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.580914  4048 ts_tablet_manager.cc:1434] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:12:26.582245  4048 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
W20260709 12:12:26.584573  3972 leader_election.cc:343] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.567827  4054 leader_election.cc:290] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.591040  4064 raft_consensus.cc:515] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.592337  4055 raft_consensus.cc:515] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.594723  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d419a53f57ce43f88240c3695e093c02" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:26.595554  3934 raft_consensus.cc:3060] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.598100  4050 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.598024  4068 raft_consensus.cc:493] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.598680  4050 ts_tablet_manager.cc:1403] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.000s
I20260709 12:12:26.598665  4068 raft_consensus.cc:515] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.599179  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.599874  3859 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 0.
I20260709 12:12:26.601634  3971 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:26.601770  4050 raft_consensus.cc:359] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.602479  4050 raft_consensus.cc:385] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.602594  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.602787  4050 raft_consensus.cc:740] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.602787  4056 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.603664  4056 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.604023  4056 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:26.604167  3972 leader_election.cc:343] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.604696  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.604192  4050 consensus_queue.cc:260] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.605057  4068 leader_election.cc:290] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
W20260709 12:12:26.606146  3971 leader_election.cc:343] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.606725  3971 leader_election.cc:304] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2; no voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:26.608057  4068 raft_consensus.cc:2749] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.609251  4055 leader_election.cc:290] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.611207  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:26.611946  3932 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.619655  4048 tablet_bootstrap.cc:654] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.624785  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.627323  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.627549  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.628144  3859 raft_consensus.cc:2393] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08e845ab2acb48ac94212e039371b50f in current term 1: Already voted for candidate 1ba47a6932f54687bb742b0d0244f158 in this term.
W20260709 12:12:26.630466  3823 leader_election.cc:343] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.630617  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
W20260709 12:12:26.631420  3823 leader_election.cc:343] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.631858  3823 leader_election.cc:304] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ba47a6932f54687bb742b0d0244f158; no voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:26.632421  4048 tablet_bootstrap.cc:492] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.632901  4048 ts_tablet_manager.cc:1403] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.000s
W20260709 12:12:26.633051  3823 leader_election.cc:343] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.633313  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.633860  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d419a53f57ce43f88240c3695e093c02" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.634455  4008 raft_consensus.cc:2468] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
W20260709 12:12:26.634615  3898 leader_election.cc:343] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.635077  3898 leader_election.cc:304] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f; no voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:26.637068  4048 raft_consensus.cc:359] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.638075  4048 raft_consensus.cc:385] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.638424  4048 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.639384  4048 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.641940  4048 ts_tablet_manager.cc:1434] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:26.643220  4055 raft_consensus.cc:2749] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.643419  4048 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.646749  3932 raft_consensus.cc:2468] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:26.655480  4054 raft_consensus.cc:2749] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.654582  3934 raft_consensus.cc:2468] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:26.658007  3823 leader_election.cc:304] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:26.658752  4064 leader_election.cc:290] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.654582  4048 tablet_bootstrap.cc:654] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.654703  4049 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.650648  4056 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.661635  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d419a53f57ce43f88240c3695e093c02" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:26.661867  4050 ts_tablet_manager.cc:1434] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.039s
I20260709 12:12:26.662276  4008 raft_consensus.cc:3060] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.663100  4050 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.660436  3823 leader_election.cc:304] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:26.667582  4055 raft_consensus.cc:2804] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.667791  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:26.668684  4049 ts_tablet_manager.cc:1403] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.015s
I20260709 12:12:26.668418  3859 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.670586  4050 tablet_bootstrap.cc:654] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.672768  4085 raft_consensus.cc:493] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.673329  4085 raft_consensus.cc:515] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.675709  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:26.676267  4056 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319)
I20260709 12:12:26.685501  4008 raft_consensus.cc:2468] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:26.687397  3934 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.689983  3859 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 1.
I20260709 12:12:26.691331  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.691301  3971 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:26.692391  4056 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.692935  4056 raft_consensus.cc:697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
W20260709 12:12:26.693701  3823 leader_election.cc:343] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.693811  4056 consensus_queue.cc:237] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:26.694754  4085 leader_election.cc:290] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.695613  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
W20260709 12:12:26.696983  3823 leader_election.cc:343] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.697422  3823 leader_election.cc:304] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ba47a6932f54687bb742b0d0244f158; no voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:26.698539  4050 tablet_bootstrap.cc:492] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.659377  4064 raft_consensus.cc:2804] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.698477  4085 raft_consensus.cc:2749] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.689417  4049 raft_consensus.cc:359] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.699184  4048 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.699281  4050 ts_tablet_manager.cc:1403] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.023s
I20260709 12:12:26.699595  4049 raft_consensus.cc:385] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.699162  4064 raft_consensus.cc:697] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:26.700004  4049 raft_consensus.cc:740] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.700095  4048 ts_tablet_manager.cc:1403] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 12:12:26.701036  4064 consensus_queue.cc:237] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.702757  4050 raft_consensus.cc:359] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.703642  4050 raft_consensus.cc:385] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.704118  4050 raft_consensus.cc:740] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.703779  4048 raft_consensus.cc:359] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.703696  4049 consensus_queue.cc:260] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.704763  4048 raft_consensus.cc:385] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.705173  4048 raft_consensus.cc:740] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.705016  4050 consensus_queue.cc:260] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.706265  4048 consensus_queue.cc:260] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.707690  4050 ts_tablet_manager.cc:1434] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:26.708842  4050 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.709859  4049 ts_tablet_manager.cc:1434] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:12:26.712944  4055 raft_consensus.cc:697] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:26.714205  4055 consensus_queue.cc:237] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.716806  4048 ts_tablet_manager.cc:1434] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:12:26.717176  4050 tablet_bootstrap.cc:654] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.720634  4049 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.727445  4048 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.726562  3755 catalog_manager.cc:5697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.729353  3934 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 1.
I20260709 12:12:26.734776  4049 tablet_bootstrap.cc:654] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.737730  4048 tablet_bootstrap.cc:654] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.753146  4055 raft_consensus.cc:493] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.753918  4055 raft_consensus.cc:515] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.758469  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.757949  3754 catalog_manager.cc:5697] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:26.760848  3823 leader_election.cc:343] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.764515  4048 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.765283  4048 ts_tablet_manager.cc:1403] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.004s
I20260709 12:12:26.767309  4055 leader_election.cc:290] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.769764  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
W20260709 12:12:26.771919  3823 leader_election.cc:343] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.772593  3823 leader_election.cc:304] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ba47a6932f54687bb742b0d0244f158; no voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:26.773871  4048 raft_consensus.cc:359] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.775511  4055 raft_consensus.cc:2749] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.774904  4048 raft_consensus.cc:385] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.777364  4048 raft_consensus.cc:740] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.778108  4050 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.778652  4050 ts_tablet_manager.cc:1403] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.070s	user 0.035s	sys 0.030s
I20260709 12:12:26.778275  4048 consensus_queue.cc:260] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.780838  4048 ts_tablet_manager.cc:1434] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:12:26.782135  4050 raft_consensus.cc:359] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.782979  4050 raft_consensus.cc:385] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.783528  4048 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.786425  4049 tablet_bootstrap.cc:492] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.787557  4050 raft_consensus.cc:740] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.792399  4050 consensus_queue.cc:260] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.795581  4048 tablet_bootstrap.cc:654] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.797129  4050 ts_tablet_manager.cc:1434] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:12:26.798866  4050 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.799111  4049 ts_tablet_manager.cc:1403] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.017s
I20260709 12:12:26.802604  4049 raft_consensus.cc:359] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.803447  4049 raft_consensus.cc:385] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.803745  4049 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.804617  4049 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.807214  4049 ts_tablet_manager.cc:1434] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:26.808214  4049 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.809412  4050 tablet_bootstrap.cc:654] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.813194  4054 raft_consensus.cc:493] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.813730  4054 raft_consensus.cc:515] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.814484  4049 tablet_bootstrap.cc:654] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.815690  3754 catalog_manager.cc:5697] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.820786  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.821827  4008 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:26.824129  3898 leader_election.cc:304] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:26.825678  4074 raft_consensus.cc:2804] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.826210  4074 raft_consensus.cc:493] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.826684  4074 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.828999  4048 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.829540  4048 ts_tablet_manager.cc:1403] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.007s
I20260709 12:12:26.832796  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.833768  3859 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:26.838852  4054 leader_election.cc:290] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.832839  4048 raft_consensus.cc:359] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.842585  4048 raft_consensus.cc:385] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.846724  4048 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.850096  4048 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.855650  4074 raft_consensus.cc:515] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.858970  4074 leader_election.cc:290] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.860535  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:26.861397  3859 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.863651  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:26.864446  4008 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.870162  4056 raft_consensus.cc:493] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.870820  4056 raft_consensus.cc:515] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.875304  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
W20260709 12:12:26.877375  3971 leader_election.cc:343] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.877556  3859 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:26.880290  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.881196  3934 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 0.
I20260709 12:12:26.882836  3972 leader_election.cc:304] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:26.883329  3897 leader_election.cc:304] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:26.884027  4056 leader_election.cc:290] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:26.884130  4081 raft_consensus.cc:2804] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.884554  4081 raft_consensus.cc:493] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.884697  4074 raft_consensus.cc:2804] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.884917  4081 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.885547  4074 raft_consensus.cc:697] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:26.886933  4074 consensus_queue.cc:237] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.890021  4008 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:26.892601  4081 raft_consensus.cc:515] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.892597  4048 ts_tablet_manager.cc:1434] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.002s
I20260709 12:12:26.896281  4049 tablet_bootstrap.cc:492] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.895967  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:26.896499  4048 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.896915  4049 ts_tablet_manager.cc:1403] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.089s	user 0.042s	sys 0.035s
W20260709 12:12:26.897680  3971 leader_election.cc:343] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.899724  4049 raft_consensus.cc:359] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.900188  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:26.900547  4049 raft_consensus.cc:385] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.900861  3934 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.900995  4049 raft_consensus.cc:740] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.901885  4049 consensus_queue.cc:260] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.898767  3754 catalog_manager.cc:5697] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 1 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.903450  4048 tablet_bootstrap.cc:654] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.904263  4049 ts_tablet_manager.cc:1434] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:26.905280  4049 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: Bootstrap starting.
I20260709 12:12:26.907532  4050 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.907982  4050 ts_tablet_manager.cc:1403] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.109s	user 0.059s	sys 0.013s
I20260709 12:12:26.910705  4050 raft_consensus.cc:359] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.911273  4049 tablet_bootstrap.cc:654] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.911469  4050 raft_consensus.cc:385] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.911765  4050 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.912545  4050 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.916512  4050 ts_tablet_manager.cc:1434] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:26.917732  4050 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.918596  4056 raft_consensus.cc:493] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.919159  4056 raft_consensus.cc:515] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.921478  4056 leader_election.cc:290] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:26.922796  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.923700  3932 raft_consensus.cc:2393] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 158279150a30440080e9b1d0732c4bb2 in current term 1: Already voted for candidate 1ba47a6932f54687bb742b0d0244f158 in this term.
I20260709 12:12:26.926561  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.927748  4050 tablet_bootstrap.cc:654] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.928184  3971 leader_election.cc:304] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2; no voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:26.930074  4056 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.937366  3934 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 1.
I20260709 12:12:26.939669  4050 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.938773  3972 leader_election.cc:304] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:26.940377  4050 ts_tablet_manager.cc:1403] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 12:12:26.940532  4068 raft_consensus.cc:2804] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.944479  4081 leader_election.cc:290] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:26.944294  4050 raft_consensus.cc:359] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.945457  4050 raft_consensus.cc:385] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.945873  4050 raft_consensus.cc:740] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.944339  4056 raft_consensus.cc:2749] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.947146  4050 consensus_queue.cc:260] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.949106  4049 tablet_bootstrap.cc:492] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: No bootstrap required, opened a new log
I20260709 12:12:26.949609  4049 ts_tablet_manager.cc:1403] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.015s
I20260709 12:12:26.949728  4068 raft_consensus.cc:697] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:26.950098  4050 ts_tablet_manager.cc:1434] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:26.951129  4050 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: Bootstrap starting.
I20260709 12:12:26.950824  4068 consensus_queue.cc:237] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.952910  4048 tablet_bootstrap.cc:492] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.952562  4049 raft_consensus.cc:359] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.953752  4055 raft_consensus.cc:493] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.954545  4048 ts_tablet_manager.cc:1403] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.022s
I20260709 12:12:26.954437  4055 raft_consensus.cc:515] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.956826  4055 leader_election.cc:290] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:26.957907  4048 raft_consensus.cc:359] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.958724  4048 raft_consensus.cc:385] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.959133  4048 raft_consensus.cc:740] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.959419  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.959847  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:26.959975  4048 consensus_queue.cc:260] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.960654  3934 raft_consensus.cc:2393] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ba47a6932f54687bb742b0d0244f158 in current term 1: Already voted for candidate 158279150a30440080e9b1d0732c4bb2 in this term.
I20260709 12:12:26.959403  4050 tablet_bootstrap.cc:654] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.962277  3823 leader_election.cc:304] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ba47a6932f54687bb742b0d0244f158; no voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:26.962677  4048 ts_tablet_manager.cc:1434] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:26.963575  4055 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.964064  4048 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:26.969376  4049 raft_consensus.cc:385] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.969771  4049 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.970412  4056 raft_consensus.cc:493] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.970685  4049 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.971037  4056 raft_consensus.cc:515] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.971673  4048 tablet_bootstrap.cc:654] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.973459  4056 leader_election.cc:290] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:26.974320  4050 tablet_bootstrap.cc:492] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: No bootstrap required, opened a new log
I20260709 12:12:26.974822  4050 ts_tablet_manager.cc:1403] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 12:12:26.975760  4049 ts_tablet_manager.cc:1434] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:12:26.975718  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:26.976583  3859 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 0.
I20260709 12:12:26.977769  4050 raft_consensus.cc:359] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.978534  4050 raft_consensus.cc:385] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.978659  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:26.979405  3934 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 0.
I20260709 12:12:26.979496  4055 raft_consensus.cc:2749] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.981434  3972 leader_election.cc:304] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:26.982332  4056 raft_consensus.cc:2804] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.983686  4048 tablet_bootstrap.cc:492] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:26.983755  3755 catalog_manager.cc:5697] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.986332  4048 ts_tablet_manager.cc:1403] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 12:12:26.989817  4048 raft_consensus.cc:359] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.991304  4056 raft_consensus.cc:493] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.991772  4056 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.978870  4050 raft_consensus.cc:740] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.993382  4050 consensus_queue.cc:260] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:26.995721  4050 ts_tablet_manager.cc:1434] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:26.991015  4048 raft_consensus.cc:385] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.998302  4048 raft_consensus.cc:740] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.999389  4048 consensus_queue.cc:260] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.003775  4056 raft_consensus.cc:515] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.006466  4048 ts_tablet_manager.cc:1434] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:12:27.007272  4056 leader_election.cc:290] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:27.007539  4048 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: Bootstrap starting.
I20260709 12:12:27.007962  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.008445  3934 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.010365  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.011134  3859 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.014822  4048 tablet_bootstrap.cc:654] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.016840  3934 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 1.
I20260709 12:12:27.018146  3972 leader_election.cc:304] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:27.019227  3859 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 1.
I20260709 12:12:27.019277  4056 raft_consensus.cc:2804] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.021366  4056 raft_consensus.cc:697] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:27.022359  4056 consensus_queue.cc:237] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.028457  4048 tablet_bootstrap.cc:492] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: No bootstrap required, opened a new log
I20260709 12:12:27.029112  4048 ts_tablet_manager.cc:1403] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 12:12:27.032006  4048 raft_consensus.cc:359] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.032582  4048 raft_consensus.cc:385] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.032825  4048 raft_consensus.cc:740] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.033444  4048 consensus_queue.cc:260] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.033342  3757 catalog_manager.cc:5697] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.035395  4048 ts_tablet_manager.cc:1434] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:27.039748  4074 raft_consensus.cc:493] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.040334  4074 raft_consensus.cc:515] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.042480  4074 leader_election.cc:290] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.043439  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:27.044404  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:27.044400  3859 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:27.045200  4008 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:27.046150  3897 leader_election.cc:304] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.047127  4074 raft_consensus.cc:2804] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.047508  4074 raft_consensus.cc:493] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.047835  4074 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.052983  4074 raft_consensus.cc:515] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.054615  4074 leader_election.cc:290] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.055665  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.055958  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.056210  3859 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.056663  4008 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.061604  4008 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:27.061861  3859 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:27.062816  3898 leader_election.cc:304] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:27.063776  4074 raft_consensus.cc:2804] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.064296  4074 raft_consensus.cc:697] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.065104  4074 consensus_queue.cc:237] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.072897  3757 catalog_manager.cc:5697] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 1 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.087473  4055 consensus_queue.cc:1048] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.100226  4064 consensus_queue.cc:1048] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.105139  4064 raft_consensus.cc:493] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.105760  4064 raft_consensus.cc:515] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.108217  4064 leader_election.cc:290] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.108923  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:27.109660  3934 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:27.109941  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:27.110667  4007 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:27.110935  3823 leader_election.cc:304] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.111876  4064 raft_consensus.cc:2804] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.112309  4064 raft_consensus.cc:493] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.112702  4064 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.119954  4064 raft_consensus.cc:515] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.122133  4064 leader_election.cc:290] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.122784  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.123436  3934 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.123257  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.123943  4007 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.131569  4007 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:27.131572  3934 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:27.133097  3823 leader_election.cc:304] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.134125  4064 raft_consensus.cc:2804] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.134654  4055 raft_consensus.cc:493] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.134946  4064 raft_consensus.cc:697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.135188  4055 raft_consensus.cc:515] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.136137  4064 consensus_queue.cc:237] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.137513  4055 leader_election.cc:290] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.138633  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:27.138638  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f" is_pre_election: true
I20260709 12:12:27.139511  4007 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:27.139581  3934 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 0.
I20260709 12:12:27.141040  3823 leader_election.cc:304] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.141827  4055 raft_consensus.cc:2804] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.142217  4055 raft_consensus.cc:493] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.142566  4055 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.145165  4064 consensus_queue.cc:1048] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.145511  3755 catalog_manager.cc:5697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.149722  4055 raft_consensus.cc:515] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.156790  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.157449  3934 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.157642  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.158308  4007 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.165198  4064 consensus_queue.cc:1048] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:27.166327  4007 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:27.166366  4055 leader_election.cc:290] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.166327  3934 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 1.
I20260709 12:12:27.168216  3823 leader_election.cc:304] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.170114  4055 raft_consensus.cc:2804] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.170650  4055 raft_consensus.cc:697] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.171653  4055 consensus_queue.cc:237] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.181434  3755 catalog_manager.cc:5697] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.201841  4056 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.211644  4068 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:27.253124  3960 tablet.cc:2406] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:27.319483  4074 raft_consensus.cc:493] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.319974  4074 raft_consensus.cc:515] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.321622  4074 leader_election.cc:290] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.322435  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158" is_pre_election: true
I20260709 12:12:27.322666  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2" is_pre_election: true
I20260709 12:12:27.322958  3859 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:27.323325  4007 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 0.
I20260709 12:12:27.324079  3897 leader_election.cc:304] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.324856  4074 raft_consensus.cc:2804] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.325196  4074 raft_consensus.cc:493] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.325428  4074 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.329939  4074 raft_consensus.cc:515] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.331661  4074 leader_election.cc:290] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.332451  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.332629  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.332958  3859 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.333259  4007 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.337713  3859 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:27.338064  4007 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 1.
I20260709 12:12:27.338804  3897 leader_election.cc:304] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.339601  4074 raft_consensus.cc:2804] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.339960  4074 raft_consensus.cc:697] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.340651  4074 consensus_queue.cc:237] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.348263  3757 catalog_manager.cc:5697] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 1 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.423761  4104 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.434099  4081 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.449569  4074 consensus_queue.cc:1048] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.461937  4074 consensus_queue.cc:1048] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.475955  4074 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.493650  4129 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.507697  4081 consensus_queue.cc:1048] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.523885  4104 consensus_queue.cc:1048] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.530269  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:52746
I20260709 12:12:27.530978  4007 raft_consensus.cc:606] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:27.548110  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:59228
I20260709 12:12:27.548693  3932 raft_consensus.cc:606] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:27.556246  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:52746
I20260709 12:12:27.556809  4007 raft_consensus.cc:606] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:27.572643  3859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:53796
I20260709 12:12:27.573172  3859 raft_consensus.cc:606] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Received request to transfer leadership to TS 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:27.581462  3859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a27677e6e2f640358d54d385645cf728"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:53796
I20260709 12:12:27.582154  3859 raft_consensus.cc:606] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Received request to transfer leadership to TS 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:27.587438  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
mode: GRACEFUL
new_leader_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:52746
I20260709 12:12:27.587895  4007 raft_consensus.cc:606] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Received request to transfer leadership to TS 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:27.592504  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
mode: GRACEFUL
new_leader_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:59228
I20260709 12:12:27.592947  3932 raft_consensus.cc:606] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Received request to transfer leadership to TS 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:27.642968  4055 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.654134  4055 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.665992  4064 raft_consensus.cc:993] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.666457  4055 raft_consensus.cc:1081] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Signalling peer 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.668243  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:59206
I20260709 12:12:27.669016  3932 raft_consensus.cc:493] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.669425  3932 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.674463  3932 raft_consensus.cc:515] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.676389  3932 leader_election.cc:290] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.677307  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.677531  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.677969  3859 raft_consensus.cc:3055] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.678122  4007 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.678378  3859 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.679342  3859 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.680721  3859 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.683568  4007 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.684659  3898 leader_election.cc:304] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:27.685330  4129 raft_consensus.cc:2804] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.685740  4129 raft_consensus.cc:697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.686187  3859 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.686592  4129 consensus_queue.cc:237] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.693029  3757 catalog_manager.cc:5697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 1 to 2, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 2 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.693817  4055 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.704867  4084 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.712815  4064 raft_consensus.cc:993] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.713250  4084 raft_consensus.cc:1081] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Signalling peer 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.714777  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a27677e6e2f640358d54d385645cf728"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:59206
I20260709 12:12:27.715297  3932 raft_consensus.cc:493] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.715607  3932 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.720816  3932 raft_consensus.cc:515] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.722445  3932 leader_election.cc:290] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.723664  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.723578  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.724265  3859 raft_consensus.cc:3055] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.724378  4007 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.724678  3859 raft_consensus.cc:740] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.725528  3859 consensus_queue.cc:260] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.726747  3859 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.729441  4007 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.730499  3898 leader_election.cc:304] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:27.731287  4129 raft_consensus.cc:2804] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.731724  4129 raft_consensus.cc:697] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.732583  3859 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.732550  4129 consensus_queue.cc:237] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.739199  3757 catalog_manager.cc:5697] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 1 to 2, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 2 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.784667  4081 raft_consensus.cc:993] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.785166  4104 raft_consensus.cc:1081] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.786799  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53784
I20260709 12:12:27.787338  3859 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.787640  3859 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.792290  3859 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:27.794015  3859 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.795065  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.795217  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.795771  3932 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.795841  4007 raft_consensus.cc:3055] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.796229  4007 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:27.797068  4007 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:27.798272  4007 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.802636  3932 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.804003  3823 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.804821  4084 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.805017  4007 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.805243  4084 raft_consensus.cc:697] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.806160  4084 consensus_queue.cc:237] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:27.810683  4129 consensus_queue.cc:1048] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.812870  3757 catalog_manager.cc:5697] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 1 to 2, leader changed from 158279150a30440080e9b1d0732c4bb2 (127.3.34.195) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.821027  4074 consensus_queue.cc:1048] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.828682  4129 raft_consensus.cc:993] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: : Instructing follower 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:27.829136  4126 raft_consensus.cc:1081] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Signalling peer 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:27.830955  4007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:52738
I20260709 12:12:27.831523  4007 raft_consensus.cc:493] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.831894  4007 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.836798  4007 raft_consensus.cc:515] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.838771  4007 leader_election.cc:290] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 2 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:27.839891  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.840541  3859 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.840610  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85445c1fda1442a9d0882530345a1a3" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.841259  3932 raft_consensus.cc:3055] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.841574  3932 raft_consensus.cc:740] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.842381  3932 consensus_queue.cc:260] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.843537  3932 raft_consensus.cc:3060] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.846246  3859 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 2.
I20260709 12:12:27.847540  3971 leader_election.cc:304] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.848417  4104 raft_consensus.cc:2804] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.848913  4104 raft_consensus.cc:697] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 2 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:27.849386  3932 raft_consensus.cc:2468] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 2.
I20260709 12:12:27.849666  4104 consensus_queue.cc:237] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.856428  3757 catalog_manager.cc:5697] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 1 to 2, leader changed from 08e845ab2acb48ac94212e039371b50f (127.3.34.194) to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.885717  4081 raft_consensus.cc:993] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.886286  4104 raft_consensus.cc:1081] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.888119  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53784
I20260709 12:12:27.888715  3859 raft_consensus.cc:493] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.889168  3859 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.893263  4129 raft_consensus.cc:993] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.893805  4126 raft_consensus.cc:1081] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:27.895686  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53790
I20260709 12:12:27.896319  3858 raft_consensus.cc:493] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.896242  3859 raft_consensus.cc:515] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.896776  3858 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.898324  3859 leader_election.cc:290] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.899544  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.899487  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.900352  3932 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.900327  4007 raft_consensus.cc:3055] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.900957  4007 raft_consensus.cc:740] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:27.901878  4007 consensus_queue.cc:260] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.903261  4007 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.903362  3858 raft_consensus.cc:515] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.905414  3858 leader_election.cc:290] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.906687  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.907022  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:27.907356  4008 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.907594  3934 raft_consensus.cc:3055] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.907940  3934 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.908103  3932 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.908849  3934 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.909788  3823 leader_election.cc:304] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.910301  3934 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.910662  4084 raft_consensus.cc:2804] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.911212  4084 raft_consensus.cc:697] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.912115  4084 consensus_queue.cc:237] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.916898  4007 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.917294  3934 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.917721  4008 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:27.919116  3823 leader_election.cc:304] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.920048  4084 raft_consensus.cc:2804] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.920634  4084 raft_consensus.cc:697] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:27.921655  4084 consensus_queue.cc:237] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.922032  3757 catalog_manager.cc:5697] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 1 to 2, leader changed from 158279150a30440080e9b1d0732c4bb2 (127.3.34.195) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.936163  3757 catalog_manager.cc:5697] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 1 to 2, leader changed from 08e845ab2acb48ac94212e039371b50f (127.3.34.194) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.965670  4081 raft_consensus.cc:993] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: : Instructing follower 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.966156  4104 raft_consensus.cc:1081] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Signalling peer 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:27.967700  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:59218
I20260709 12:12:27.968196  3934 raft_consensus.cc:493] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:27.968555  3934 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.973326  3934 raft_consensus.cc:515] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.975087  3934 leader_election.cc:290] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:27.976104  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:27.976281  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051edc6de6d41bab39cac834f5ea2a5" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:27.976708  4008 raft_consensus.cc:3055] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:27.976794  3858 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.977105  4008 raft_consensus.cc:740] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:27.977919  4008 consensus_queue.cc:260] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.979173  4008 raft_consensus.cc:3060] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:27.983758  3858 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.984967  3897 leader_election.cc:304] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:27.985739  4126 raft_consensus.cc:2804] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:27.985848  4008 raft_consensus.cc:2468] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:27.986177  4126 raft_consensus.cc:697] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:27.987128  4126 consensus_queue.cc:237] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:27.994006  3757 catalog_manager.cc:5697] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 1 to 2, leader changed from 158279150a30440080e9b1d0732c4bb2 (127.3.34.195) to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 2 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.163414  3858 raft_consensus.cc:1275] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.164692  4126 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.172088  4008 raft_consensus.cc:1275] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.173838  4129 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.196974  3858 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.198951  4074 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.208578  4007 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.210711  4126 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.281899  3858 raft_consensus.cc:1275] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.283232  4104 consensus_queue.cc:1048] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.290951  3934 raft_consensus.cc:1275] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.292434  4068 consensus_queue.cc:1048] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.306363  3934 raft_consensus.cc:1275] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.307755  4084 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.307951  4007 raft_consensus.cc:1275] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.309126  4084 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.325865  4008 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.327124  4084 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.335506  3934 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.337296  4084 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.351866  4008 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.353067  4084 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.360165  3934 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.361932  4143 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.433552  3859 raft_consensus.cc:1275] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.434811  4126 consensus_queue.cc:1048] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.442278  4008 raft_consensus.cc:1275] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.444626  4074 consensus_queue.cc:1048] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.626000  3211 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:30.626709  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.642601  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:30.643268  3858 raft_consensus.cc:606] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Received request to transfer leadership to TS 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:30.646299  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:30.647014  3858 raft_consensus.cc:606] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Received request to transfer leadership to TS 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:30.648116  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:30.648604  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.802959  4143 raft_consensus.cc:993] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:30.803524  4150 raft_consensus.cc:1081] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Signalling peer 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:30.805171  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:12:30.805754  4008 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.806083  4008 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.812366  4008 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:30.814956  4008 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 3 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319)
I20260709 12:12:30.815173  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:30.815953  3934 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.815855  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:30.816521  3858 raft_consensus.cc:3055] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.816848  3858 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:30.817683  3858 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:30.818897  3858 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.823128  3934 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 3.
I20260709 12:12:30.824512  3972 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:30.825380  4068 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.826414  3858 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 3.
I20260709 12:12:30.826460  4068 raft_consensus.cc:697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:30.827586  4068 consensus_queue.cc:237] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:30.835474  3754 catalog_manager.cc:5697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 2 to 3, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.935418  4143 raft_consensus.cc:993] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:30.935885  4143 raft_consensus.cc:1081] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Signalling peer 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:30.937449  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:12:30.938038  4008 raft_consensus.cc:493] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.938398  4008 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.943507  4008 raft_consensus.cc:515] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:30.945425  4008 leader_election.cc:290] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 3 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:30.946604  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:30.946718  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:30.947443  3858 raft_consensus.cc:3055] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.947464  3934 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.948031  3858 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:30.949049  3858 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:30.950482  3858 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.955510  3934 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 3.
I20260709 12:12:30.956885  3972 leader_election.cc:304] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:30.957628  4068 raft_consensus.cc:2804] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.957885  3858 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 3.
I20260709 12:12:30.958191  4068 raft_consensus.cc:697] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:30.959213  4068 consensus_queue.cc:237] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:30.968725  3754 catalog_manager.cc:5697] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 2 to 3, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.261142  3934 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.263201  4068 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.273221  3858 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.274771  4151 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.521375  3934 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.522722  4151 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.533615  3858 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.535228  4165 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.649730  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.655009  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:31.655378  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.656246  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.661993  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:32.662451  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:33.663525  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.669950  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:33.670462  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:34.672128  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.678534  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:34.679078  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.680460  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.687494  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.687996  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.689050  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.694518  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:36.694978  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:37.695928  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:37.701290  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:37.701771  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:38.702752  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.708825  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:38.709308  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.710402  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.715744  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:39.716216  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:40.750792  3211 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:12:40.756460  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:52746
I20260709 12:12:40.757207  4007 raft_consensus.cc:606] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:40.763027  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:52746
I20260709 12:12:40.763619  4007 raft_consensus.cc:606] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:40.776250  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:59228
I20260709 12:12:40.776803  3932 raft_consensus.cc:606] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:40.782307  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:59228
I20260709 12:12:40.782757  3932 raft_consensus.cc:606] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:40.787248  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a27677e6e2f640358d54d385645cf728"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
mode: GRACEFUL
new_leader_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:59228
I20260709 12:12:40.787717  3932 raft_consensus.cc:606] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Received request to transfer leadership to TS 1ba47a6932f54687bb742b0d0244f158
I20260709 12:12:40.822213  4175 raft_consensus.cc:993] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.822803  4170 raft_consensus.cc:1081] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.824759  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53790
I20260709 12:12:40.825206  3858 raft_consensus.cc:493] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.825500  3858 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.831182  3858 raft_consensus.cc:515] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.833186  3858 leader_election.cc:290] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 3 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:40.834123  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:40.834472  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:40.835137  3932 raft_consensus.cc:3055] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:40.835130  4007 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.835470  3932 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:40.836491  3932 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.837652  3932 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:40.841709  4007 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 3.
I20260709 12:12:40.844244  3823 leader_election.cc:304] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:40.845310  4176 raft_consensus.cc:2804] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:40.845196  3932 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 3.
I20260709 12:12:40.845921  4176 raft_consensus.cc:697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:40.846956  4176 consensus_queue.cc:237] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.855119  4175 raft_consensus.cc:993] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.855644  4170 raft_consensus.cc:1081] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.856452  3754 catalog_manager.cc:5697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 2 to 3, leader changed from 08e845ab2acb48ac94212e039371b50f (127.3.34.194) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.857424  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53790
I20260709 12:12:40.857946  3858 raft_consensus.cc:493] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.858325  3858 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.864343  3858 raft_consensus.cc:515] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.866665  3858 leader_election.cc:290] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:40.867362  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:40.868057  3932 raft_consensus.cc:3055] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:40.868438  3932 raft_consensus.cc:740] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:40.869444  3932 consensus_queue.cc:260] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.869905  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559794ebd31f44e3b873b912b95596f1" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:40.870486  4007 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.870941  3932 raft_consensus.cc:3060] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:40.876044  4007 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:40.876941  3932 raft_consensus.cc:2468] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 2.
I20260709 12:12:40.877000  3823 leader_election.cc:304] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:40.877998  4176 raft_consensus.cc:2804] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:40.878432  4176 raft_consensus.cc:697] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:40.879338  4176 consensus_queue.cc:237] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:40.886821  3754 catalog_manager.cc:5697] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 1 to 2, leader changed from 08e845ab2acb48ac94212e039371b50f (127.3.34.194) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.896299  4151 raft_consensus.cc:993] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.896682  4151 raft_consensus.cc:1081] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:40.898214  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53784
I20260709 12:12:40.898614  3858 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:40.898840  3858 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.903244  3858 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:40.905117  3858 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 4 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:40.906257  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:40.906121  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:40.906787  3932 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.906773  4007 raft_consensus.cc:3055] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:40.907351  4007 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:40.908116  4007 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:40.909287  4007 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:40.913398  3932 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 4.
I20260709 12:12:40.914665  3823 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:40.915184  4007 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 4.
I20260709 12:12:40.915432  4176 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:40.915925  4176 raft_consensus.cc:697] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:40.916827  4176 consensus_queue.cc:237] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:40.923360  3754 catalog_manager.cc:5697] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 3 to 4, leader changed from 158279150a30440080e9b1d0732c4bb2 (127.3.34.195) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.033165  4170 raft_consensus.cc:993] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:41.033737  4175 raft_consensus.cc:1081] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:41.035535  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a27677e6e2f640358d54d385645cf728"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53790
I20260709 12:12:41.036217  3858 raft_consensus.cc:493] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.036706  3858 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:41.041460  3858 raft_consensus.cc:515] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.043128  3858 leader_election.cc:290] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 3 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:41.043836  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:41.044042  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27677e6e2f640358d54d385645cf728" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:41.044421  3932 raft_consensus.cc:3055] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:41.044540  4007 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:41.044718  3932 raft_consensus.cc:740] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:41.045553  3932 consensus_queue.cc:260] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.046554  3932 raft_consensus.cc:3060] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:41.049201  4007 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 3.
I20260709 12:12:41.050136  3823 leader_election.cc:304] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 158279150a30440080e9b1d0732c4bb2, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:41.050806  4176 raft_consensus.cc:2804] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:41.050875  3932 raft_consensus.cc:2468] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 3.
I20260709 12:12:41.051347  4176 raft_consensus.cc:697] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:41.052186  4176 consensus_queue.cc:237] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.059044  3754 catalog_manager.cc:5697] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 2 to 3, leader changed from 08e845ab2acb48ac94212e039371b50f (127.3.34.194) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.078505  4183 raft_consensus.cc:993] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: : Instructing follower 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:41.079027  4151 raft_consensus.cc:1081] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Signalling peer 1ba47a6932f54687bb742b0d0244f158 to start an election
I20260709 12:12:41.080642  3858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "322db566acfc49c4912c354f77dcb761"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
 from {username='slave'} at 127.0.0.1:53784
I20260709 12:12:41.081130  3858 raft_consensus.cc:493] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.081504  3858 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.085978  3858 raft_consensus.cc:515] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.087706  3858 leader_election.cc:290] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 4 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:41.088474  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:41.088796  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "322db566acfc49c4912c354f77dcb761" candidate_uuid: "1ba47a6932f54687bb742b0d0244f158" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:41.089057  3932 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.089372  4007 raft_consensus.cc:3055] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:41.089634  4007 raft_consensus.cc:740] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:41.090266  4007 consensus_queue.cc:260] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.091174  4007 raft_consensus.cc:3060] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:41.093757  3932 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 4.
I20260709 12:12:41.094831  3823 leader_election.cc:304] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 1ba47a6932f54687bb742b0d0244f158; no voters: 
I20260709 12:12:41.095506  4007 raft_consensus.cc:2468] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ba47a6932f54687bb742b0d0244f158 in term 4.
I20260709 12:12:41.095618  4176 raft_consensus.cc:2804] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:41.096167  4176 raft_consensus.cc:697] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Becoming Leader. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:41.096956  4176 consensus_queue.cc:237] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:41.103404  3754 catalog_manager.cc:5697] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 reported cstate change: term changed from 3 to 4, leader changed from 158279150a30440080e9b1d0732c4bb2 (127.3.34.195) to 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "1ba47a6932f54687bb742b0d0244f158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.309175  3932 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.310535  4176 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.320644  4007 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.322503  4176 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:41.349831  3932 raft_consensus.cc:1275] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.351133  4143 consensus_queue.cc:1048] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:41.364796  4007 raft_consensus.cc:1275] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.367044  4194 consensus_queue.cc:1048] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:41.411861  4007 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.413127  4189 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:41.422206  3932 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.423619  4189 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:41.447641  3932 raft_consensus.cc:1275] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.449079  4189 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.458473  4007 raft_consensus.cc:1275] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:41.460163  4194 consensus_queue.cc:1048] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:41.492523  4007 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.493760  4194 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:41.502466  3932 raft_consensus.cc:1275] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Refusing update from remote peer 1ba47a6932f54687bb742b0d0244f158: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:41.504325  4176 consensus_queue.cc:1048] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:43.827373  3211 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:12:43.828177  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.836390  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:43.836961  3858 raft_consensus.cc:606] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Received request to transfer leadership to TS 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:43.840255  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:43.840898  3858 raft_consensus.cc:606] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Received request to transfer leadership to TS 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:43.843536  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:43.844003  3858 raft_consensus.cc:606] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Received request to transfer leadership to TS 158279150a30440080e9b1d0732c4bb2
I20260709 12:12:43.846213  3858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2"
dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
mode: GRACEFUL
new_leader_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:53802
I20260709 12:12:43.846635  3858 raft_consensus.cc:606] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Received request to transfer leadership to TS 08e845ab2acb48ac94212e039371b50f
I20260709 12:12:43.847750  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:43.848248  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.937938  4203 raft_consensus.cc:993] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:43.938434  4202 raft_consensus.cc:1081] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Signalling peer 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:43.939841  4007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:12:43.940310  4007 raft_consensus.cc:493] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.940604  4007 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.945364  4007 raft_consensus.cc:515] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:43.947504  4007 leader_election.cc:290] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 5 election: Requested vote from peers 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611), 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319)
I20260709 12:12:43.948179  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:43.948561  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb643afb0f5a463882f7ac1c4f7401db" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:43.948819  3934 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.949150  3858 raft_consensus.cc:3055] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:43.949402  3858 raft_consensus.cc:740] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:43.949956  3858 consensus_queue.cc:260] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:43.950762  3858 raft_consensus.cc:3060] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:43.953424  3934 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 5.
I20260709 12:12:43.954576  3972 leader_election.cc:304] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:43.955214  3858 raft_consensus.cc:2468] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 5.
I20260709 12:12:43.955386  4151 raft_consensus.cc:2804] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:43.956372  4151 raft_consensus.cc:697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 5 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:43.957036  4151 consensus_queue.cc:237] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } }
I20260709 12:12:43.963719  3757 catalog_manager.cc:5697] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 4 to 5, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.095680  4203 raft_consensus.cc:993] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:44.096164  4203 raft_consensus.cc:1081] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Signalling peer 158279150a30440080e9b1d0732c4bb2 to start an election
I20260709 12:12:44.097965  4007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4"
dest_uuid: "158279150a30440080e9b1d0732c4bb2"
 from {username='slave'} at 127.0.0.1:52736
I20260709 12:12:44.098448  4007 raft_consensus.cc:493] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.098738  4007 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.102952  4007 raft_consensus.cc:515] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.104374  4007 leader_election.cc:290] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 4 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 08e845ab2acb48ac94212e039371b50f (127.3.34.194:43611)
I20260709 12:12:44.105316  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e845ab2acb48ac94212e039371b50f"
I20260709 12:12:44.105237  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2f42cfa4a04ae88b4b155cc1c6adc4" candidate_uuid: "158279150a30440080e9b1d0732c4bb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:44.105932  3934 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.106004  3858 raft_consensus.cc:3055] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:44.106318  3858 raft_consensus.cc:740] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:44.107046  3858 consensus_queue.cc:260] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.108136  3858 raft_consensus.cc:3060] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:44.112241  3934 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 4.
I20260709 12:12:44.113390  3972 leader_election.cc:304] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:44.114010  3858 raft_consensus.cc:2468] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 158279150a30440080e9b1d0732c4bb2 in term 4.
I20260709 12:12:44.114143  4151 raft_consensus.cc:2804] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:44.114624  4151 raft_consensus.cc:697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 4 LEADER]: Becoming Leader. State: Replica: 158279150a30440080e9b1d0732c4bb2, State: Running, Role: LEADER
I20260709 12:12:44.115480  4151 consensus_queue.cc:237] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.121721  3757 catalog_manager.cc:5697] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 reported cstate change: term changed from 3 to 4, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 158279150a30440080e9b1d0732c4bb2 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "158279150a30440080e9b1d0732c4bb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.195330  4203 raft_consensus.cc:993] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:44.195858  4210 raft_consensus.cc:1081] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Signalling peer 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:44.197410  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:59206
I20260709 12:12:44.198006  3934 raft_consensus.cc:493] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.198324  3934 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.202812  3934 raft_consensus.cc:515] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.204842  3934 leader_election.cc:290] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 3 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:44.205732  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:44.206030  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "914a5c12f9d84f7b878d039fcc69beda" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:44.206310  3858 raft_consensus.cc:3055] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:44.206578  4007 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.206684  3858 raft_consensus.cc:740] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:44.207585  3858 consensus_queue.cc:260] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.208513  3858 raft_consensus.cc:3060] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.211352  4007 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 3.
I20260709 12:12:44.212630  3898 leader_election.cc:304] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:44.213276  3858 raft_consensus.cc:2468] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 3.
I20260709 12:12:44.213559  4170 raft_consensus.cc:2804] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:44.214851  4170 raft_consensus.cc:697] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 3 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:44.215781  4170 consensus_queue.cc:237] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.223155  3757 catalog_manager.cc:5697] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 2 to 3, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 3 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.247610  4203 raft_consensus.cc:993] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: : Instructing follower 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:44.248062  4210 raft_consensus.cc:1081] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Signalling peer 08e845ab2acb48ac94212e039371b50f to start an election
I20260709 12:12:44.249689  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2"
dest_uuid: "08e845ab2acb48ac94212e039371b50f"
 from {username='slave'} at 127.0.0.1:59206
I20260709 12:12:44.250135  3934 raft_consensus.cc:493] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.250379  3934 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.254741  3934 raft_consensus.cc:515] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.256102  3934 leader_election.cc:290] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Requested vote from peers 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319), 158279150a30440080e9b1d0732c4bb2 (127.3.34.195:36193)
I20260709 12:12:44.256958  3858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ba47a6932f54687bb742b0d0244f158"
I20260709 12:12:44.257139  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c44fb5a6e2c64f81ace469ffb82dcde2" candidate_uuid: "08e845ab2acb48ac94212e039371b50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "158279150a30440080e9b1d0732c4bb2"
I20260709 12:12:44.257499  3858 raft_consensus.cc:3055] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:44.257622  4007 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.257797  3858 raft_consensus.cc:740] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ba47a6932f54687bb742b0d0244f158, State: Running, Role: LEADER
I20260709 12:12:44.258558  3858 consensus_queue.cc:260] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.259423  3858 raft_consensus.cc:3060] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.261929  4007 raft_consensus.cc:2468] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:44.262791  3898 leader_election.cc:304] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e845ab2acb48ac94212e039371b50f, 158279150a30440080e9b1d0732c4bb2; no voters: 
I20260709 12:12:44.263545  4170 raft_consensus.cc:2804] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:44.263832  3858 raft_consensus.cc:2468] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e845ab2acb48ac94212e039371b50f in term 2.
I20260709 12:12:44.263939  4170 raft_consensus.cc:697] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Becoming Leader. State: Replica: 08e845ab2acb48ac94212e039371b50f, State: Running, Role: LEADER
I20260709 12:12:44.264853  4170 consensus_queue.cc:237] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } }
I20260709 12:12:44.271462  3757 catalog_manager.cc:5697] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f reported cstate change: term changed from 1 to 2, leader changed from 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193) to 08e845ab2acb48ac94212e039371b50f (127.3.34.194). New cstate: current_term: 2 leader_uuid: "08e845ab2acb48ac94212e039371b50f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.395345  3858 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 5 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:44.396682  4151 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:44.407847  3932 raft_consensus.cc:1275] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 5 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:44.409585  4151 consensus_queue.cc:1048] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:44.503809  3858 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:44.505646  4151 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:44.518949  3932 raft_consensus.cc:1275] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Refusing update from remote peer 158279150a30440080e9b1d0732c4bb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:44.520802  4204 consensus_queue.cc:1048] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e845ab2acb48ac94212e039371b50f" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:44.604816  3858 raft_consensus.cc:1275] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:44.606201  4170 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:44.619305  4007 raft_consensus.cc:1275] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:44.620868  4225 consensus_queue.cc:1048] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:44.748211  3858 raft_consensus.cc:1275] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.749879  4225 consensus_queue.cc:1048] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba47a6932f54687bb742b0d0244f158" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 36319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:44.760083  4007 raft_consensus.cc:1275] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Refusing update from remote peer 08e845ab2acb48ac94212e039371b50f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.761644  4225 consensus_queue.cc:1048] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [LEADER]: Connected to new peer: Peer: permanent_uuid: "158279150a30440080e9b1d0732c4bb2" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 36193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:44.849623  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.855314  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:44.855785  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:45.856841  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.863845  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:45.864300  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:46.865260  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.871248  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:46.871798  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:47.872701  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.878322  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:47.878808  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:49.067458  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.072734  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:49.073200  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:49.341606  3955 debug-util.cc:398] Leaking SignalData structure 0x7b0800111060 after lost signal to thread 3214
W20260709 12:12:49.342411  3955 debug-util.cc:398] Leaking SignalData structure 0x7b0800111740 after lost signal to thread 3791
W20260709 12:12:49.343204  3955 debug-util.cc:398] Leaking SignalData structure 0x7b080008d3a0 after lost signal to thread 3883
W20260709 12:12:49.343972  3955 debug-util.cc:398] Leaking SignalData structure 0x7b0800098de0 after lost signal to thread 3958
W20260709 12:12:49.344712  3955 debug-util.cc:398] Leaking SignalData structure 0x7b08001bffa0 after lost signal to thread 4032
I20260709 12:12:50.074407  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:50.084112  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:50.084693  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.085865  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.093947  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:51.094524  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:52.095685  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:52.102007  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:52.102515  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:53.103469  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.108609  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:53.109072  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:54.143973  3211 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:12:54.144811  3211 tablet_server.cc:179] TabletServer@127.3.34.193:0 shutting down...
I20260709 12:12:54.180646  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:54.181581  3211 tablet_replica.cc:333] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.182365  3211 raft_consensus.cc:2243] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.182880  3211 raft_consensus.cc:2272] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.184890  3211 tablet_replica.cc:333] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.185444  3211 raft_consensus.cc:2243] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.185860  3211 raft_consensus.cc:2272] T 914a5c12f9d84f7b878d039fcc69beda P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.187803  3211 tablet_replica.cc:333] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.188324  3211 raft_consensus.cc:2243] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.189292  3211 raft_consensus.cc:2272] T 322db566acfc49c4912c354f77dcb761 P 1ba47a6932f54687bb742b0d0244f158 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.191269  3211 tablet_replica.cc:333] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.191825  3211 raft_consensus.cc:2243] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.192262  3211 raft_consensus.cc:2272] T c051edc6de6d41bab39cac834f5ea2a5 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.194195  3211 tablet_replica.cc:333] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.194923  3211 raft_consensus.cc:2243] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.195456  3211 raft_consensus.cc:2272] T c44fb5a6e2c64f81ace469ffb82dcde2 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.197238  3211 tablet_replica.cc:333] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.197737  3211 raft_consensus.cc:2243] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.198490  3211 raft_consensus.cc:2272] T a27677e6e2f640358d54d385645cf728 P 1ba47a6932f54687bb742b0d0244f158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.200417  3211 tablet_replica.cc:333] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.200914  3211 raft_consensus.cc:2243] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.201661  3211 raft_consensus.cc:2272] T 559794ebd31f44e3b873b912b95596f1 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.203239  3211 tablet_replica.cc:333] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.203742  3211 raft_consensus.cc:2243] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.204130  3211 raft_consensus.cc:2272] T d85445c1fda1442a9d0882530345a1a3 P 1ba47a6932f54687bb742b0d0244f158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.205765  3211 tablet_replica.cc:333] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.206221  3211 raft_consensus.cc:2243] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.206974  3211 raft_consensus.cc:2272] T d419a53f57ce43f88240c3695e093c02 P 1ba47a6932f54687bb742b0d0244f158 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.208510  3211 tablet_replica.cc:333] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158: stopping tablet replica
I20260709 12:12:54.208966  3211 raft_consensus.cc:2243] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.209410  3211 raft_consensus.cc:2272] T bb643afb0f5a463882f7ac1c4f7401db P 1ba47a6932f54687bb742b0d0244f158 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.219142  3971 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:12:54.222512  3971 consensus_peers.cc:597] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 -> Peer 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319): Couldn't send request to peer 1ba47a6932f54687bb742b0d0244f158. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.242153  3211 tablet_server.cc:196] TabletServer@127.3.34.193:0 shutdown complete.
I20260709 12:12:54.264227  3211 tablet_server.cc:179] TabletServer@127.3.34.194:0 shutting down...
W20260709 12:12:54.280388  3971 consensus_peers.cc:597] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 -> Peer 1ba47a6932f54687bb742b0d0244f158 (127.3.34.193:36319): Couldn't send request to peer 1ba47a6932f54687bb742b0d0244f158. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:36319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.295356  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:54.296069  3211 tablet_replica.cc:333] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.296712  3211 raft_consensus.cc:2243] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.297295  3211 raft_consensus.cc:2272] T d85445c1fda1442a9d0882530345a1a3 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.299396  3211 tablet_replica.cc:333] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.299942  3211 raft_consensus.cc:2243] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.300788  3211 raft_consensus.cc:2272] T c051edc6de6d41bab39cac834f5ea2a5 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.302598  3211 tablet_replica.cc:333] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.303200  3211 raft_consensus.cc:2243] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.303642  3211 raft_consensus.cc:2272] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.305238  3211 tablet_replica.cc:333] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.305754  3211 raft_consensus.cc:2243] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.306519  3211 raft_consensus.cc:2272] T 914a5c12f9d84f7b878d039fcc69beda P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.308192  3211 tablet_replica.cc:333] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.308712  3211 raft_consensus.cc:2243] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.309126  3211 raft_consensus.cc:2272] T d419a53f57ce43f88240c3695e093c02 P 08e845ab2acb48ac94212e039371b50f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.311084  3211 tablet_replica.cc:333] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.311587  3211 raft_consensus.cc:2243] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.312011  3211 raft_consensus.cc:2272] T bb643afb0f5a463882f7ac1c4f7401db P 08e845ab2acb48ac94212e039371b50f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.313906  3211 tablet_replica.cc:333] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.314416  3211 raft_consensus.cc:2243] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.314903  3211 raft_consensus.cc:2272] T 322db566acfc49c4912c354f77dcb761 P 08e845ab2acb48ac94212e039371b50f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.316767  3211 tablet_replica.cc:333] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.317282  3211 raft_consensus.cc:2243] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.317745  3211 raft_consensus.cc:2272] T a27677e6e2f640358d54d385645cf728 P 08e845ab2acb48ac94212e039371b50f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.319372  3211 tablet_replica.cc:333] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.319865  3211 raft_consensus.cc:2243] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.320288  3211 raft_consensus.cc:2272] T 559794ebd31f44e3b873b912b95596f1 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.321863  3211 tablet_replica.cc:333] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f: stopping tablet replica
I20260709 12:12:54.322321  3211 raft_consensus.cc:2243] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.323060  3211 raft_consensus.cc:2272] T c44fb5a6e2c64f81ace469ffb82dcde2 P 08e845ab2acb48ac94212e039371b50f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.369946  3211 tablet_server.cc:196] TabletServer@127.3.34.194:0 shutdown complete.
I20260709 12:12:54.390898  3211 tablet_server.cc:179] TabletServer@127.3.34.195:0 shutting down...
I20260709 12:12:54.419080  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:54.419773  3211 tablet_replica.cc:333] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.420444  3211 raft_consensus.cc:2243] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.421317  3211 raft_consensus.cc:2272] T d85445c1fda1442a9d0882530345a1a3 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.423645  3211 tablet_replica.cc:333] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.424203  3211 raft_consensus.cc:2243] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.425124  3211 raft_consensus.cc:2272] T 1a2f42cfa4a04ae88b4b155cc1c6adc4 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.426831  3211 tablet_replica.cc:333] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.427441  3211 raft_consensus.cc:2243] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.427915  3211 raft_consensus.cc:2272] T c051edc6de6d41bab39cac834f5ea2a5 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.429745  3211 tablet_replica.cc:333] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.430260  3211 raft_consensus.cc:2243] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.430685  3211 raft_consensus.cc:2272] T c44fb5a6e2c64f81ace469ffb82dcde2 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.432345  3211 tablet_replica.cc:333] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.432870  3211 raft_consensus.cc:2243] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.433310  3211 raft_consensus.cc:2272] T 559794ebd31f44e3b873b912b95596f1 P 158279150a30440080e9b1d0732c4bb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.434914  3211 tablet_replica.cc:333] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.435568  3211 raft_consensus.cc:2243] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.436028  3211 raft_consensus.cc:2272] T a27677e6e2f640358d54d385645cf728 P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.437691  3211 tablet_replica.cc:333] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.438218  3211 raft_consensus.cc:2243] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.438640  3211 raft_consensus.cc:2272] T d419a53f57ce43f88240c3695e093c02 P 158279150a30440080e9b1d0732c4bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.440440  3211 tablet_replica.cc:333] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.440959  3211 raft_consensus.cc:2243] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.441720  3211 raft_consensus.cc:2272] T bb643afb0f5a463882f7ac1c4f7401db P 158279150a30440080e9b1d0732c4bb2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.443571  3211 tablet_replica.cc:333] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.444080  3211 raft_consensus.cc:2243] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.444532  3211 raft_consensus.cc:2272] T 914a5c12f9d84f7b878d039fcc69beda P 158279150a30440080e9b1d0732c4bb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.446285  3211 tablet_replica.cc:333] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2: stopping tablet replica
I20260709 12:12:54.446808  3211 raft_consensus.cc:2243] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.447281  3211 raft_consensus.cc:2272] T 322db566acfc49c4912c354f77dcb761 P 158279150a30440080e9b1d0732c4bb2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.477236  3211 tablet_server.cc:196] TabletServer@127.3.34.195:0 shutdown complete.
I20260709 12:12:54.498082  3211 master.cc:562] Master@127.3.34.254:34671 shutting down...
I20260709 12:12:54.537498  3211 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.538661  3211 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.539165  3211 tablet_replica.cc:333] T 00000000000000000000000000000000 P c965a98e1f764b1bb253c141f4dd7b74: stopping tablet replica
I20260709 12:12:54.561884  3211 master.cc:584] Master@127.3.34.254:34671 shutdown complete.
08e845ab2acb48ac94212e039371b50f  4
158279150a30440080e9b1d0732c4bb2  1
1ba47a6932f54687bb742b0d0244f158  5
08e845ab2acb48ac94212e039371b50f  4
158279150a30440080e9b1d0732c4bb2  3
1ba47a6932f54687bb742b0d0244f158  3
08e845ab2acb48ac94212e039371b50f  1
158279150a30440080e9b1d0732c4bb2  1
1ba47a6932f54687bb742b0d0244f158  8
08e845ab2acb48ac94212e039371b50f  3
158279150a30440080e9b1d0732c4bb2  3
1ba47a6932f54687bb742b0d0244f158  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29310 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:12:54.608561  3211 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.34.254:42447
I20260709 12:12:54.609879  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.616439  4239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.616658  4240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.617391  4242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.618053  3211 server_base.cc:1061] running on GCE node
I20260709 12:12:54.619154  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.619336  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.619542  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599174619509 us; error 0 us; skew 500 ppm
I20260709 12:12:54.620107  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.622840  3211 webserver.cc:533] Webserver started at http://127.3.34.254:33003/ using document root <none> and password file <none>
I20260709 12:12:54.623386  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.623621  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.623972  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.625373  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/master-0-root/instance:
uuid: "80c5c66c0e8a46988f2121bdd70f2876"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.630214  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:12:54.633857  4247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.634826  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:54.635192  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/master-0-root
uuid: "80c5c66c0e8a46988f2121bdd70f2876"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.635520  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:54.668242  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:54.669513  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:54.709451  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.254:42447
I20260709 12:12:54.709563  4298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.254:42447 every 8 connection(s)
I20260709 12:12:54.713913  4299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.725616  4299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Bootstrap starting.
I20260709 12:12:54.731027  4299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.735706  4299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: No bootstrap required, opened a new log
I20260709 12:12:54.738449  4299 raft_consensus.cc:359] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER }
I20260709 12:12:54.738978  4299 raft_consensus.cc:385] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.739274  4299 raft_consensus.cc:740] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80c5c66c0e8a46988f2121bdd70f2876, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.739919  4299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER }
I20260709 12:12:54.740490  4299 raft_consensus.cc:399] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:54.740769  4299 raft_consensus.cc:493] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:54.741101  4299 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.746017  4299 raft_consensus.cc:515] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER }
I20260709 12:12:54.746662  4299 leader_election.cc:304] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80c5c66c0e8a46988f2121bdd70f2876; no voters: 
I20260709 12:12:54.747897  4299 leader_election.cc:290] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:54.748332  4302 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.749771  4302 raft_consensus.cc:697] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 1 LEADER]: Becoming Leader. State: Replica: 80c5c66c0e8a46988f2121bdd70f2876, State: Running, Role: LEADER
I20260709 12:12:54.750530  4302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER }
I20260709 12:12:54.751320  4299 sys_catalog.cc:565] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:54.757655  4304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80c5c66c0e8a46988f2121bdd70f2876. Latest consensus state: current_term: 1 leader_uuid: "80c5c66c0e8a46988f2121bdd70f2876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER } }
I20260709 12:12:54.758044  4303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80c5c66c0e8a46988f2121bdd70f2876" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80c5c66c0e8a46988f2121bdd70f2876" member_type: VOTER } }
I20260709 12:12:54.758276  4304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:54.758534  4303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:54.760604  4309 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:54.769580  4309 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:54.770650  3211 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:54.779254  4309 catalog_manager.cc:1383] Generated new cluster ID: cd0b013e69bd42649762aaa58f8ed617
I20260709 12:12:54.779597  4309 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:54.797325  4309 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:54.798697  4309 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:54.815054  4309 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Generated new TSK 0
I20260709 12:12:54.815660  4309 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:54.837301  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.844025  4320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.844810  4321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.846284  4323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.848536  3211 server_base.cc:1061] running on GCE node
I20260709 12:12:54.849535  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.849771  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.849896  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599174849885 us; error 0 us; skew 500 ppm
I20260709 12:12:54.850418  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.852831  3211 webserver.cc:533] Webserver started at http://127.3.34.193:33053/ using document root <none> and password file <none>
I20260709 12:12:54.853330  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.853485  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.853695  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.854800  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/instance:
uuid: "6f6e8442c230466296caa54a80810609"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.859262  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:54.862711  4328 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.863580  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:54.863829  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
uuid: "6f6e8442c230466296caa54a80810609"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.864179  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:54.877490  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:54.878703  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:54.880172  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:54.882474  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:54.882647  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.882961  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:54.883152  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:54.925094  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.193:41885
I20260709 12:12:54.925201  4390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.193:41885 every 8 connection(s)
I20260709 12:12:54.930358  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.937463  4395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.938688  4396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.941766  4399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.942651  3211 server_base.cc:1061] running on GCE node
I20260709 12:12:54.944272  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.944631  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.944880  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599174944859 us; error 0 us; skew 500 ppm
I20260709 12:12:54.945524  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.948315  4391 heartbeater.cc:344] Connected to a master server at 127.3.34.254:42447
I20260709 12:12:54.948591  3211 webserver.cc:533] Webserver started at http://127.3.34.194:35107/ using document root <none> and password file <none>
I20260709 12:12:54.948750  4391 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:54.949244  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.949512  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.949688  4391 heartbeater.cc:507] Master 127.3.34.254:42447 requested a full tablet report, sending...
I20260709 12:12:54.949836  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.951350  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/instance:
uuid: "6b40d129d452470ba95c63b1eb11f804"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.952519  4264 ts_manager.cc:194] Registered new tserver with Master: 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:12:54.954612  4264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45302
I20260709 12:12:54.956746  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:54.961226  4403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.962049  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:54.962419  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
uuid: "6b40d129d452470ba95c63b1eb11f804"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-x5d7"
I20260709 12:12:54.962687  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:54.982002  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:54.983204  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:54.984643  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:54.987246  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:54.987453  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.987737  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:54.987900  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.029587  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.194:33573
I20260709 12:12:55.029687  4465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.194:33573 every 8 connection(s)
I20260709 12:12:55.034871  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.042575  4469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.045737  4470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.046653  3211 server_base.cc:1061] running on GCE node
W20260709 12:12:55.047387  4472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.048640  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.048921  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.049156  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599175049134 us; error 0 us; skew 500 ppm
I20260709 12:12:55.049417  4466 heartbeater.cc:344] Connected to a master server at 127.3.34.254:42447
I20260709 12:12:55.049836  4466 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.049973  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.050920  4466 heartbeater.cc:507] Master 127.3.34.254:42447 requested a full tablet report, sending...
I20260709 12:12:55.053371  3211 webserver.cc:533] Webserver started at http://127.3.34.195:42371/ using document root <none> and password file <none>
I20260709 12:12:55.053839  4264 ts_manager.cc:194] Registered new tserver with Master: 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:55.054111  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.054426  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.054778  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.055900  4264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45306
I20260709 12:12:55.056533  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/instance:
uuid: "a359ff757b3a4babb1229aa08bc44a60"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-x5d7"
I20260709 12:12:55.062047  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:12:55.066219  4477 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.067135  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:55.067488  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
uuid: "a359ff757b3a4babb1229aa08bc44a60"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-x5d7"
I20260709 12:12:55.067809  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.098724  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.100167  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.101778  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.104351  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.104619  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.104918  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.105122  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.152151  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.195:46537
I20260709 12:12:55.152318  4539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.195:46537 every 8 connection(s)
I20260709 12:12:55.167524  4540 heartbeater.cc:344] Connected to a master server at 127.3.34.254:42447
I20260709 12:12:55.167887  4540 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.168612  4540 heartbeater.cc:507] Master 127.3.34.254:42447 requested a full tablet report, sending...
I20260709 12:12:55.170776  4264 ts_manager.cc:194] Registered new tserver with Master: a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:55.170913  3211 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014983361s
I20260709 12:12:55.172377  4264 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45316
I20260709 12:12:55.198203  4264 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:55.204550  4264 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:55.411988  4356 tablet_service.cc:1511] Processing CreateTablet for tablet b53244c88a364677a229b3af6a2c00ac (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:55.413698  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53244c88a364677a229b3af6a2c00ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.414516  4355 tablet_service.cc:1511] Processing CreateTablet for tablet f0eddf8c8603444b95052dfcd6ec14ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:55.415894  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eddf8c8603444b95052dfcd6ec14ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.413231  4354 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9248ceaf4ba3937a4604adcb0295 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:55.419863  4354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9248ceaf4ba3937a4604adcb0295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.423084  4353 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bef78062e4451b98d19e752efb309 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:55.424525  4353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bef78062e4451b98d19e752efb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.428299  4352 tablet_service.cc:1511] Processing CreateTablet for tablet 8ace27fd51bc488ca513d42f77ae9744 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:55.429812  4352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ace27fd51bc488ca513d42f77ae9744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.429527  4504 tablet_service.cc:1511] Processing CreateTablet for tablet f0eddf8c8603444b95052dfcd6ec14ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:55.430873  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eddf8c8603444b95052dfcd6ec14ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.428299  4505 tablet_service.cc:1511] Processing CreateTablet for tablet b53244c88a364677a229b3af6a2c00ac (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:55.432323  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53244c88a364677a229b3af6a2c00ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.433239  4501 tablet_service.cc:1511] Processing CreateTablet for tablet 8ace27fd51bc488ca513d42f77ae9744 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:55.434710  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ace27fd51bc488ca513d42f77ae9744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.434870  4431 tablet_service.cc:1511] Processing CreateTablet for tablet b53244c88a364677a229b3af6a2c00ac (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:55.436192  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53244c88a364677a229b3af6a2c00ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.438321  4430 tablet_service.cc:1511] Processing CreateTablet for tablet f0eddf8c8603444b95052dfcd6ec14ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:55.439563  4503 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9248ceaf4ba3937a4604adcb0295 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:55.440893  4503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9248ceaf4ba3937a4604adcb0295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.441725  4429 tablet_service.cc:1511] Processing CreateTablet for tablet d90f9248ceaf4ba3937a4604adcb0295 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:55.444170  4428 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bef78062e4451b98d19e752efb309 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:55.446619  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 8ace27fd51bc488ca513d42f77ae9744 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:55.438321  4502 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bef78062e4451b98d19e752efb309 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:55.453577  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bef78062e4451b98d19e752efb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.455893  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eddf8c8603444b95052dfcd6ec14ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.457173  4351 tablet_service.cc:1511] Processing CreateTablet for tablet 6f130dbf22aa4fec863590cd97a47f17 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:55.458554  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f130dbf22aa4fec863590cd97a47f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.459334  4429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90f9248ceaf4ba3937a4604adcb0295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.461668  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ace27fd51bc488ca513d42f77ae9744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.462950  4426 tablet_service.cc:1511] Processing CreateTablet for tablet 6f130dbf22aa4fec863590cd97a47f17 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:55.464915  4428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bef78062e4451b98d19e752efb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.465677  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f130dbf22aa4fec863590cd97a47f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.497990  4350 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ed95ce6be4de980a07c4834b46498 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:55.499483  4350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ed95ce6be4de980a07c4834b46498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.499632  4425 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ed95ce6be4de980a07c4834b46498 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:55.503522  4503 tablet_service.cc:1511] Processing CreateTablet for tablet 6f130dbf22aa4fec863590cd97a47f17 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:55.505681  4503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f130dbf22aa4fec863590cd97a47f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.513249  4502 tablet_service.cc:1511] Processing CreateTablet for tablet 1c0ed95ce6be4de980a07c4834b46498 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:55.514775  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ed95ce6be4de980a07c4834b46498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.520205  4555 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:55.521260  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ed95ce6be4de980a07c4834b46498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.560544  4556 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:55.562223  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 0d85ac676e004b609f70d47ae2ac3c44 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:55.563704  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d85ac676e004b609f70d47ae2ac3c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.564234  4555 tablet_bootstrap.cc:654] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.566536  4557 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:55.568982  4556 tablet_bootstrap.cc:654] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.569413  4501 tablet_service.cc:1511] Processing CreateTablet for tablet 0d85ac676e004b609f70d47ae2ac3c44 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:55.570879  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d85ac676e004b609f70d47ae2ac3c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.572947  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 0d85ac676e004b609f70d47ae2ac3c44 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:55.573781  4557 tablet_bootstrap.cc:654] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.574249  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d85ac676e004b609f70d47ae2ac3c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.586010  4351 tablet_service.cc:1511] Processing CreateTablet for tablet c1602309b0f64e5da65bbe212dcd8578 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:55.587481  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1602309b0f64e5da65bbe212dcd8578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.591274  4555 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:55.591814  4555 ts_tablet_manager.cc:1403] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.003s
I20260709 12:12:55.595227  4555 raft_consensus.cc:359] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.596029  4555 raft_consensus.cc:385] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.596343  4555 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.597347  4555 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.599864  4427 tablet_service.cc:1511] Processing CreateTablet for tablet c1602309b0f64e5da65bbe212dcd8578 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:55.601433  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1602309b0f64e5da65bbe212dcd8578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.601776  4557 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:55.602438  4557 ts_tablet_manager.cc:1403] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.005s
I20260709 12:12:55.606494  4557 raft_consensus.cc:359] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.607486  4557 raft_consensus.cc:385] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.607878  4557 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.609836  4540 heartbeater.cc:499] Master 127.3.34.254:42447 was elected leader, sending a full tablet report...
I20260709 12:12:55.609591  4557 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.612442  4555 ts_tablet_manager.cc:1434] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:12:55.613493  4555 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:55.619810  4466 heartbeater.cc:499] Master 127.3.34.254:42447 was elected leader, sending a full tablet report...
I20260709 12:12:55.620388  4503 tablet_service.cc:1511] Processing CreateTablet for tablet c1602309b0f64e5da65bbe212dcd8578 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:55.622016  4556 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:55.622532  4556 ts_tablet_manager.cc:1403] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.027s
I20260709 12:12:55.625943  4556 raft_consensus.cc:359] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.626844  4556 raft_consensus.cc:385] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.627028  4503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1602309b0f64e5da65bbe212dcd8578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.627230  4556 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.627969  4557 ts_tablet_manager.cc:1434] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:12:55.628268  4556 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.629030  4557 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:55.631114  4555 tablet_bootstrap.cc:654] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.636021  4557 tablet_bootstrap.cc:654] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.642148  4555 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:55.642657  4555 ts_tablet_manager.cc:1403] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 12:12:55.644697  4431 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3e66082564439be8a3b4a0292e958 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:55.646034  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3e66082564439be8a3b4a0292e958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.645664  4555 raft_consensus.cc:359] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.646435  4555 raft_consensus.cc:385] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.646744  4555 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.647542  4555 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.648607  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 414c481bb7ad485898e5ed66d8a38344 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:55.650372  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414c481bb7ad485898e5ed66d8a38344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.654373  4555 ts_tablet_manager.cc:1434] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:55.654675  4504 tablet_service.cc:1511] Processing CreateTablet for tablet 011d2125e98642bfaa9d1a5c58747e7e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:55.654798  4502 tablet_service.cc:1511] Processing CreateTablet for tablet d27bb118c5cf4d81b9951fd5ed73bf31 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:55.656044  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d2125e98642bfaa9d1a5c58747e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.657223  4500 tablet_service.cc:1511] Processing CreateTablet for tablet 649a2c7d074941a39496be2ed5768f58 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:55.657264  4505 tablet_service.cc:1511] Processing CreateTablet for tablet 414c481bb7ad485898e5ed66d8a38344 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:55.658738  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27bb118c5cf4d81b9951fd5ed73bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.659377  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414c481bb7ad485898e5ed66d8a38344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.659693  4555 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:55.641285  4351 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3e66082564439be8a3b4a0292e958 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:55.661022  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3e66082564439be8a3b4a0292e958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.664697  4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a2c7d074941a39496be2ed5768f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.671824  4429 tablet_service.cc:1511] Processing CreateTablet for tablet 414c481bb7ad485898e5ed66d8a38344 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:55.673663  4429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414c481bb7ad485898e5ed66d8a38344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.676424  4425 tablet_service.cc:1511] Processing CreateTablet for tablet d27bb118c5cf4d81b9951fd5ed73bf31 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:55.678171  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27bb118c5cf4d81b9951fd5ed73bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.680016  4501 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3e66082564439be8a3b4a0292e958 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:55.680454  4355 tablet_service.cc:1511] Processing CreateTablet for tablet d27bb118c5cf4d81b9951fd5ed73bf31 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:55.681641  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3e66082564439be8a3b4a0292e958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.682173  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27bb118c5cf4d81b9951fd5ed73bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.684525  4350 tablet_service.cc:1511] Processing CreateTablet for tablet 011d2125e98642bfaa9d1a5c58747e7e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:55.686242  4350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d2125e98642bfaa9d1a5c58747e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.693892  4562 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.694427  4562 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.695123  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 011d2125e98642bfaa9d1a5c58747e7e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:55.696453  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d2125e98642bfaa9d1a5c58747e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.696002  4430 tablet_service.cc:1511] Processing CreateTablet for tablet 649a2c7d074941a39496be2ed5768f58 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:55.702704  4557 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:55.703552  4557 ts_tablet_manager.cc:1403] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.019s
I20260709 12:12:55.704762  4561 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.699348  4354 tablet_service.cc:1511] Processing CreateTablet for tablet 649a2c7d074941a39496be2ed5768f58 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:55.706743  4561 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.708338  4354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a2c7d074941a39496be2ed5768f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.708828  4557 raft_consensus.cc:359] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.709692  4557 raft_consensus.cc:385] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.709859  4561 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:55.710126  4557 raft_consensus.cc:740] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.711289  4557 consensus_queue.cc:260] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.697708  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a2c7d074941a39496be2ed5768f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.728048  4562 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:55.723635  4555 tablet_bootstrap.cc:654] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.744589  4503 tablet_service.cc:1511] Processing CreateTablet for tablet a04eae5aed3946b19b6d1c1b40af70ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:55.749361  4499 tablet_service.cc:1511] Processing CreateTablet for tablet 88fc213635c44d9584958cbc80077ad1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 12:12:55.764511  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.769733  4498 tablet_service.cc:1511] Processing CreateTablet for tablet 2e80f7c2589340f0b76dfe7449339a9d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:55.780606  4497 tablet_service.cc:1511] Processing CreateTablet for tablet 9abe6120f15d41dd8f67749ea3529089 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:55.794345  4496 tablet_service.cc:1511] Processing CreateTablet for tablet c6942a9e429240fcb7987e82e7a08f52 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:55.807101  4556 ts_tablet_manager.cc:1434] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.184s	user 0.030s	sys 0.087s
I20260709 12:12:55.807919  4391 heartbeater.cc:499] Master 127.3.34.254:42447 was elected leader, sending a full tablet report...
I20260709 12:12:55.808228  4556 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:55.814905  4556 tablet_bootstrap.cc:654] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.830482  4503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04eae5aed3946b19b6d1c1b40af70ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.849575  4557 ts_tablet_manager.cc:1434] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.145s	user 0.006s	sys 0.018s
I20260709 12:12:55.857260  4569 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.864042  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6942a9e429240fcb7987e82e7a08f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.866969  4426 tablet_service.cc:1511] Processing CreateTablet for tablet a04eae5aed3946b19b6d1c1b40af70ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:55.868227  4561 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.875119  4561 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.875063  4569 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.876657  4352 tablet_service.cc:1511] Processing CreateTablet for tablet 88fc213635c44d9584958cbc80077ad1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:55.877300  4561 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:55.877413  4499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fc213635c44d9584958cbc80077ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.877826  4569 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:55.877936  4352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fc213635c44d9584958cbc80077ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.891026  4557 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:55.891840  4428 tablet_service.cc:1511] Processing CreateTablet for tablet 88fc213635c44d9584958cbc80077ad1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:55.893353  4428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fc213635c44d9584958cbc80077ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.895493  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04eae5aed3946b19b6d1c1b40af70ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.895859  4353 tablet_service.cc:1511] Processing CreateTablet for tablet 2e80f7c2589340f0b76dfe7449339a9d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:55.897289  4353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e80f7c2589340f0b76dfe7449339a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.904313  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e80f7c2589340f0b76dfe7449339a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.915128  4502 tablet_service.cc:1511] Processing CreateTablet for tablet 8afbdad4342642f89b3c8be7ce7da5dc (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:55.918344  4504 tablet_service.cc:1511] Processing CreateTablet for tablet d7aa6aedab9d4e14b16124d91af2f154 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:55.919764  4555 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:55.920202  4555 ts_tablet_manager.cc:1403] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.265s	user 0.015s	sys 0.014s
I20260709 12:12:55.922502  4555 raft_consensus.cc:359] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.923192  4555 raft_consensus.cc:385] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.923640  4555 raft_consensus.cc:740] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.923266  4500 tablet_service.cc:1511] Processing CreateTablet for tablet 19356d2adb334f6fa9ec07c452d14046 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:55.927628  4555 consensus_queue.cc:260] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.933272  4555 ts_tablet_manager.cc:1434] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:12:55.934451  4555 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:55.936134  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 9abe6120f15d41dd8f67749ea3529089 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:55.936712  4349 tablet_service.cc:1511] Processing CreateTablet for tablet c6942a9e429240fcb7987e82e7a08f52 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:55.937533  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abe6120f15d41dd8f67749ea3529089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.938220  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6942a9e429240fcb7987e82e7a08f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.939767  4424 tablet_service.cc:1511] Processing CreateTablet for tablet 2e80f7c2589340f0b76dfe7449339a9d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:55.940320  4348 tablet_service.cc:1511] Processing CreateTablet for tablet 19356d2adb334f6fa9ec07c452d14046 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:55.941140  4424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e80f7c2589340f0b76dfe7449339a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.941840  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19356d2adb334f6fa9ec07c452d14046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.944490  4347 tablet_service.cc:1511] Processing CreateTablet for tablet 8afbdad4342642f89b3c8be7ce7da5dc (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:55.952641  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abe6120f15d41dd8f67749ea3529089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.956861  4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19356d2adb334f6fa9ec07c452d14046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.959268  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7aa6aedab9d4e14b16124d91af2f154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.960813  4556 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:55.961308  4556 ts_tablet_manager.cc:1403] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.012s
I20260709 12:12:55.967135  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbdad4342642f89b3c8be7ce7da5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.969412  4423 tablet_service.cc:1511] Processing CreateTablet for tablet 9abe6120f15d41dd8f67749ea3529089 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:55.970928  4423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abe6120f15d41dd8f67749ea3529089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.971261  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:55.972926  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:55.973673  4440 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:55.975441  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:55.976003  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbdad4342642f89b3c8be7ce7da5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.975943  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:55.976145  4515 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:55.976428  4422 tablet_service.cc:1511] Processing CreateTablet for tablet c6942a9e429240fcb7987e82e7a08f52 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:55.976836  4514 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:55.977970  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6942a9e429240fcb7987e82e7a08f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.983758  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:55.984737  4569 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.984602  4431 tablet_service.cc:1511] Processing CreateTablet for tablet 19356d2adb334f6fa9ec07c452d14046 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:55.985198  4569 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.985670  4569 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.986044  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19356d2adb334f6fa9ec07c452d14046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.991205  4501 tablet_service.cc:1511] Processing CreateTablet for tablet 9a539d67362a4305b85e3c294bc7c2a8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:55.992587  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a539d67362a4305b85e3c294bc7c2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.994107  4569 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:55.996564  4430 tablet_service.cc:1511] Processing CreateTablet for tablet d7aa6aedab9d4e14b16124d91af2f154 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:55.997313  4406 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.025477  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.018935  4350 tablet_service.cc:1511] Processing CreateTablet for tablet e4d2f3f375e94f79a0dd385679b944aa (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.048055  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7aa6aedab9d4e14b16124d91af2f154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.048642  4350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d2f3f375e94f79a0dd385679b944aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.050462  4562 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:56.050365  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55296.7us
I20260709 12:12:56.036840  4555 tablet_bootstrap.cc:654] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.050971  4562 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.051566  4562 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.054901  4569 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.008425  4556 raft_consensus.cc:359] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.009498  4505 tablet_service.cc:1511] Processing CreateTablet for tablet e4d2f3f375e94f79a0dd385679b944aa (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.055771  4556 raft_consensus.cc:385] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.056174  4556 raft_consensus.cc:740] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.057116  4556 consensus_queue.cc:260] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.012498  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 8afbdad4342642f89b3c8be7ce7da5dc (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 12:12:56.013559  4481 leader_election.cc:343] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.014909  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:12:56.058779  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45426.5us
I20260709 12:12:56.016012  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.059573  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.023386  4351 tablet_service.cc:1511] Processing CreateTablet for tablet a04eae5aed3946b19b6d1c1b40af70ca (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:56.019634  4355 tablet_service.cc:1511] Processing CreateTablet for tablet d7aa6aedab9d4e14b16124d91af2f154 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:56.026446  4425 tablet_service.cc:1511] Processing CreateTablet for tablet 9a539d67362a4305b85e3c294bc7c2a8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:56.060041  4556 ts_tablet_manager.cc:1434] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.002s
I20260709 12:12:56.087095  4556 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:56.024832  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.061654  4561 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.077564  4500 tablet_service.cc:1511] Processing CreateTablet for tablet c34020fa889c4752979db51ac86d3251 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.061560  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04eae5aed3946b19b6d1c1b40af70ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.088265  4352 tablet_service.cc:1511] Processing CreateTablet for tablet 113336c186624ff989dd5bad91201a95 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:56.061906  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbdad4342642f89b3c8be7ce7da5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.062107  4557 tablet_bootstrap.cc:654] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.063491  4562 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.068359  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:56.094852  4561 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.089936  4429 tablet_service.cc:1511] Processing CreateTablet for tablet 113336c186624ff989dd5bad91201a95 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 12:12:56.068717  4481 leader_election.cc:343] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.073930  4563 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.077767  4363 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:56.069151  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d2f3f375e94f79a0dd385679b944aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.080222  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:56.006541  4354 tablet_service.cc:1511] Processing CreateTablet for tablet 9a539d67362a4305b85e3c294bc7c2a8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:56.134907  4563 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.137996  4563 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.085017  4423 tablet_service.cc:1511] Processing CreateTablet for tablet e4d2f3f375e94f79a0dd385679b944aa (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:56.114159  4561 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.097512  4356 tablet_service.cc:1511] Processing CreateTablet for tablet c34020fa889c4752979db51ac86d3251 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.142306  4422 tablet_service.cc:1511] Processing CreateTablet for tablet bdb8329d46e44c7bbc1100c6da0c55b1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.143183  4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34020fa889c4752979db51ac86d3251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.124079  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:56.095851  4348 tablet_service.cc:1511] Processing CreateTablet for tablet bdb8329d46e44c7bbc1100c6da0c55b1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.143435  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a539d67362a4305b85e3c294bc7c2a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.113622  4407 leader_election.cc:343] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.159972  4562 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.062456  4424 tablet_service.cc:1511] Processing CreateTablet for tablet c34020fa889c4752979db51ac86d3251 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:56.177208  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:56.183606  4497 tablet_service.cc:1511] Processing CreateTablet for tablet bdb8329d46e44c7bbc1100c6da0c55b1 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:56.175071  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7aa6aedab9d4e14b16124d91af2f154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.196604  4515 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.196707  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 83278us
I20260709 12:12:56.203069  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb8329d46e44c7bbc1100c6da0c55b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.211269  4429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113336c186624ff989dd5bad91201a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.225095  4515 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:56.226833  4406 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.083700  4498 tablet_service.cc:1511] Processing CreateTablet for tablet 113336c186624ff989dd5bad91201a95 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:56.227847  4562 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.231376  4562 raft_consensus.cc:697] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:56.232275  4562 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.249773  4423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d2f3f375e94f79a0dd385679b944aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.265861  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb8329d46e44c7bbc1100c6da0c55b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.252207  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34020fa889c4752979db51ac86d3251. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.272652  4407 leader_election.cc:343] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.278834  4555 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:56.279400  4555 ts_tablet_manager.cc:1403] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.345s	user 0.022s	sys 0.027s
I20260709 12:12:56.282446  4576 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.283959  4424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c34020fa889c4752979db51ac86d3251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.287334  4352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113336c186624ff989dd5bad91201a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.289791  4561 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.290967  4514 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:12:56.295473  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb8329d46e44c7bbc1100c6da0c55b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.299567  4354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a539d67362a4305b85e3c294bc7c2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.286948  4555 raft_consensus.cc:359] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.279417  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113336c186624ff989dd5bad91201a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.310345  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:56.320804  4332 leader_election.cc:343] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.311837  4430 tablet_service.cc:1511] Processing CreateTablet for tablet cd282266b4fc4ef98c399a7ea99210df (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:56.320658  4349 tablet_service.cc:1511] Processing CreateTablet for tablet cd282266b4fc4ef98c399a7ea99210df (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:56.322122  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd282266b4fc4ef98c399a7ea99210df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.322216  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:56.304311  4555 raft_consensus.cc:385] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.322857  4363 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.324482  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:56.325769  4562 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.329177  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd282266b4fc4ef98c399a7ea99210df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.329293  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 260593us
W20260709 12:12:56.330129  4481 leader_election.cc:343] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.322890  4555 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.332034  4555 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.331598  4504 tablet_service.cc:1511] Processing CreateTablet for tablet cd282266b4fc4ef98c399a7ea99210df (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:56.336405  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd282266b4fc4ef98c399a7ea99210df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.336105  4431 tablet_service.cc:1511] Processing CreateTablet for tablet 45fa02f6f7e44052aa4ac9fc517789e6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:56.342449  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fa02f6f7e44052aa4ac9fc517789e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.330544  4264 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.349706  4561 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:56.350239  4496 tablet_service.cc:1511] Processing CreateTablet for tablet 45fa02f6f7e44052aa4ac9fc517789e6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:56.351856  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fa02f6f7e44052aa4ac9fc517789e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.361074  4363 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:56.361964  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:56.364718  4347 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34886e28324e3a9e84a6ecb6b1b615 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:56.366195  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34886e28324e3a9e84a6ecb6b1b615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.367846  4348 tablet_service.cc:1511] Processing CreateTablet for tablet 45fa02f6f7e44052aa4ac9fc517789e6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:56.380403  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fa02f6f7e44052aa4ac9fc517789e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.376813  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:56.387627  4440 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:56.389564  4556 tablet_bootstrap.cc:654] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:56.378484  4331 leader_election.cc:343] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.391283  4555 ts_tablet_manager.cc:1434] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.112s	user 0.004s	sys 0.004s
I20260709 12:12:56.391192  4331 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:56.392108  4563 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.392531  4555 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:56.394666  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:12:56.396077  4481 leader_election.cc:343] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.396576  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:56.403187  4561 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.372540  4557 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:56.407404  4557 ts_tablet_manager.cc:1403] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.517s	user 0.022s	sys 0.038s
I20260709 12:12:56.410408  4557 raft_consensus.cc:359] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.430012  4431 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34886e28324e3a9e84a6ecb6b1b615 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:56.431382  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34886e28324e3a9e84a6ecb6b1b615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.432538  4498 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34886e28324e3a9e84a6ecb6b1b615 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:56.433864  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34886e28324e3a9e84a6ecb6b1b615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.418000  4557 raft_consensus.cc:385] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.433000  4555 tablet_bootstrap.cc:654] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.438621  4557 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.457803  4348 tablet_service.cc:1511] Processing CreateTablet for tablet 48a5885ca40b49f9a79c3ae930090feb (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:56.459481  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a5885ca40b49f9a79c3ae930090feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.459538  4557 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.461427  4426 tablet_service.cc:1511] Processing CreateTablet for tablet 48a5885ca40b49f9a79c3ae930090feb (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:56.462095  4557 ts_tablet_manager.cc:1434] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:12:56.463068  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a5885ca40b49f9a79c3ae930090feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.470937  4557 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:56.478753  4497 tablet_service.cc:1511] Processing CreateTablet for tablet 48a5885ca40b49f9a79c3ae930090feb (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:56.480113  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a5885ca40b49f9a79c3ae930090feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.487823  4355 tablet_service.cc:1511] Processing CreateTablet for tablet 632d1ea17544468d8db4dfec9893bc7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:56.493063  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d1ea17544468d8db4dfec9893bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.493826  4557 tablet_bootstrap.cc:654] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.508658  4555 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:56.509222  4555 ts_tablet_manager.cc:1403] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.016s
I20260709 12:12:56.512463  4555 raft_consensus.cc:359] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.513290  4555 raft_consensus.cc:385] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.513651  4555 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.514457  4555 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.516857  4555 ts_tablet_manager.cc:1434] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:12:56.516673  4496 tablet_service.cc:1511] Processing CreateTablet for tablet 632d1ea17544468d8db4dfec9893bc7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:56.517995  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d1ea17544468d8db4dfec9893bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.518061  4555 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:56.524672  4555 tablet_bootstrap.cc:654] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.527745  4422 tablet_service.cc:1511] Processing CreateTablet for tablet 632d1ea17544468d8db4dfec9893bc7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:56.529565  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d1ea17544468d8db4dfec9893bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.536157  4555 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:56.536686  4555 ts_tablet_manager.cc:1403] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:12:56.539819  4555 raft_consensus.cc:359] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.540671  4555 raft_consensus.cc:385] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.540339  4557 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:56.540920  4356 tablet_service.cc:1511] Processing CreateTablet for tablet f4c35d8d5d0b41aca58011ae22cd5c02 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:56.547909  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c35d8d5d0b41aca58011ae22cd5c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.540691  4430 tablet_service.cc:1511] Processing CreateTablet for tablet f4c35d8d5d0b41aca58011ae22cd5c02 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:56.554699  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c35d8d5d0b41aca58011ae22cd5c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.554942  4349 tablet_service.cc:1511] Processing CreateTablet for tablet 549e3d5d3452435687b34025926eb9d3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:56.541028  4555 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.552939  4498 tablet_service.cc:1511] Processing CreateTablet for tablet f4c35d8d5d0b41aca58011ae22cd5c02 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:56.564234  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c35d8d5d0b41aca58011ae22cd5c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.564292  4555 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.566507  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549e3d5d3452435687b34025926eb9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.541360  4557 ts_tablet_manager.cc:1403] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.011s
I20260709 12:12:56.577332  4555 ts_tablet_manager.cc:1434] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.004s
I20260709 12:12:56.578351  4556 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:56.578286  4557 raft_consensus.cc:359] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.578488  4555 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:56.579210  4557 raft_consensus.cc:385] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.579583  4557 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.579216  4556 ts_tablet_manager.cc:1403] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.492s	user 0.033s	sys 0.026s
I20260709 12:12:56.584216  4556 raft_consensus.cc:359] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.584964  4556 raft_consensus.cc:385] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.585286  4556 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.586117  4556 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.587064  4426 tablet_service.cc:1511] Processing CreateTablet for tablet 549e3d5d3452435687b34025926eb9d3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:56.588613  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549e3d5d3452435687b34025926eb9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.595263  4556 ts_tablet_manager.cc:1434] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:56.599447  4497 tablet_service.cc:1511] Processing CreateTablet for tablet 549e3d5d3452435687b34025926eb9d3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:56.600953  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549e3d5d3452435687b34025926eb9d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.601550  4557 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.604015  4504 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:56.603272  4555 tablet_bootstrap.cc:654] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.605459  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.606293  4557 ts_tablet_manager.cc:1434] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:56.613147  4351 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:56.614666  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.616132  4425 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:56.623783  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc38aad677b4e24b4c61a7d79c8e8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.626618  4562 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.627210  4562 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.629622  4562 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.631150  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:56.631973  4514 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:56.633279  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.635771  4557 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:56.635587  4406 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.636611  4562 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:56.636881  4407 leader_election.cc:343] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.637094  4562 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.637626  4562 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.638192  4563 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.638763  4563 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.641076  4563 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.643090  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:56.643174  4355 tablet_service.cc:1511] Processing CreateTablet for tablet 049f37cd99a74aec952c95bcc63588b9 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:56.643880  4514 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:56.644632  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049f37cd99a74aec952c95bcc63588b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.644974  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:56.646677  4331 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:12:56.648414  4332 leader_election.cc:343] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.650050  4563 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.651337  4563 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.651721  4563 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.657130  4496 tablet_service.cc:1511] Processing CreateTablet for tablet 049f37cd99a74aec952c95bcc63588b9 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:56.659442  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049f37cd99a74aec952c95bcc63588b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.659963  4556 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:56.655715  4422 tablet_service.cc:1511] Processing CreateTablet for tablet 049f37cd99a74aec952c95bcc63588b9 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:56.659842  4563 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.661239  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049f37cd99a74aec952c95bcc63588b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.663414  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:12:56.665234  4332 leader_election.cc:343] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.667459  4562 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.669800  4562 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.671059  4498 tablet_service.cc:1511] Processing CreateTablet for tablet 92ab6cc386d54892aeefaf3825ef65ee (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:56.672472  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab6cc386d54892aeefaf3825ef65ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.672814  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:56.673468  4515 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.675433  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:56.676136  4514 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.679031  4561 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.679502  4561 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.681521  4561 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:56.681555  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:56.687947  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:56.689168  4555 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:56.689674  4555 ts_tablet_manager.cc:1403] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.017s
W20260709 12:12:56.689822  4481 leader_election.cc:343] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.690263  4349 tablet_service.cc:1511] Processing CreateTablet for tablet a003a2ac88974139bde682ffd3dea64c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:56.690889  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.691716  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003a2ac88974139bde682ffd3dea64c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.692315  4407 leader_election.cc:343] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:56.693921  4481 leader_election.cc:343] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.694378  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:56.695545  4561 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.697111  4430 tablet_service.cc:1511] Processing CreateTablet for tablet 92ab6cc386d54892aeefaf3825ef65ee (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:56.699112  4563 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.699647  4514 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:56.704180  4331 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:12:56.705438  4563 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.705484  4426 tablet_service.cc:1511] Processing CreateTablet for tablet a003a2ac88974139bde682ffd3dea64c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:56.667557  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 92ab6cc386d54892aeefaf3825ef65ee (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:56.706179  4502 tablet_service.cc:1511] Processing CreateTablet for tablet a003a2ac88974139bde682ffd3dea64c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:56.707651  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab6cc386d54892aeefaf3825ef65ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.710054  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab6cc386d54892aeefaf3825ef65ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.701148  4515 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:56.707695  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003a2ac88974139bde682ffd3dea64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.700423  4557 tablet_bootstrap.cc:654] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.711540  4348 tablet_service.cc:1511] Processing CreateTablet for tablet a4f3505d639448bc9bf52e138a226844 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:56.712942  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f3505d639448bc9bf52e138a226844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.719391  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003a2ac88974139bde682ffd3dea64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.720191  4406 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:56.721596  4562 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.723142  4562 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:56.724160  4562 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.730094  4556 tablet_bootstrap.cc:654] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.739207  4425 tablet_service.cc:1511] Processing CreateTablet for tablet a4f3505d639448bc9bf52e138a226844 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:56.740913  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f3505d639448bc9bf52e138a226844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.741097  4504 tablet_service.cc:1511] Processing CreateTablet for tablet a4f3505d639448bc9bf52e138a226844 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:56.743096  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f3505d639448bc9bf52e138a226844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.747462  4569 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.749060  4569 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.751509  4569 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.751847  4555 raft_consensus.cc:359] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.752774  4555 raft_consensus.cc:385] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.753113  4555 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.753808  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.754515  4363 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:56.763468  4555 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.764673  4576 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.769270  4576 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.770917  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:56.771587  4515 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:56.761620  4561 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.767419  4407 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:56.780001  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:56.780716  4440 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:56.781437  4431 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fcfdfbd34417af879705145ed5c6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:56.783097  4561 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.781528  4497 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fcfdfbd34417af879705145ed5c6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:56.785295  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fcfdfbd34417af879705145ed5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.785562  4561 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:56.787672  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.788885  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:56.789250  4355 tablet_service.cc:1511] Processing CreateTablet for tablet 0850ebb64cfc469fb421b34b4c89537e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:56.790571  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0850ebb64cfc469fb421b34b4c89537e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.790323  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.787514  4349 tablet_service.cc:1511] Processing CreateTablet for tablet 10f0fcfdfbd34417af879705145ed5c6 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:56.791767  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fcfdfbd34417af879705145ed5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.791579  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:56.782900  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fcfdfbd34417af879705145ed5c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:56.793602  4481 leader_election.cc:343] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.793924  4561 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.788960  4363 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:56.762933  4563 raft_consensus.cc:697] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:56.794447  4561 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.797436  4561 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.797683  4563 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:56.804670  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:56.804826  4561 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:56.805470  4481 leader_election.cc:343] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.806085  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:56.775051  4576 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:12:56.811473  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 49002.3us
I20260709 12:12:56.808481  4562 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.814905  4561 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:56.817319  4504 tablet_service.cc:1511] Processing CreateTablet for tablet 0850ebb64cfc469fb421b34b4c89537e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:56.821322  4264 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.833655  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0850ebb64cfc469fb421b34b4c89537e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.823652  4562 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.837438  4562 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.844018  4498 tablet_service.cc:1511] Processing CreateTablet for tablet 66db2395fb8d472bae50ea6bda5a63f8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:56.844497  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 0850ebb64cfc469fb421b34b4c89537e (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:56.845469  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66db2395fb8d472bae50ea6bda5a63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.845577  4424 tablet_service.cc:1511] Processing CreateTablet for tablet 66db2395fb8d472bae50ea6bda5a63f8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:56.845994  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0850ebb64cfc469fb421b34b4c89537e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.846815  4424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66db2395fb8d472bae50ea6bda5a63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.848001  4423 tablet_service.cc:1511] Processing CreateTablet for tablet caaa86e05efa448b8059af6c927ceffd (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:56.861006  4423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaa86e05efa448b8059af6c927ceffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.848201  4351 tablet_service.cc:1511] Processing CreateTablet for tablet 66db2395fb8d472bae50ea6bda5a63f8 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:56.851800  4352 tablet_service.cc:1511] Processing CreateTablet for tablet caaa86e05efa448b8059af6c927ceffd (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:56.853775  4555 ts_tablet_manager.cc:1434] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.164s	user 0.014s	sys 0.008s
I20260709 12:12:56.855839  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:56.856658  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:56.856626  4569 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.822793  4576 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.871724  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66db2395fb8d472bae50ea6bda5a63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.870184  4363 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.872285  4505 tablet_service.cc:1511] Processing CreateTablet for tablet caaa86e05efa448b8059af6c927ceffd (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:56.873672  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaa86e05efa448b8059af6c927ceffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.876856  4352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaa86e05efa448b8059af6c927ceffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.882336  4363 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:56.887706  4555 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:56.894426  4569 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.912361  4555 tablet_bootstrap.cc:654] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.919845  4353 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28d6bc26fc4caeac04b56caf240716 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:56.921584  4353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28d6bc26fc4caeac04b56caf240716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.913033  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:56.913324  4422 tablet_service.cc:1511] Processing CreateTablet for tablet cb845b83c8c64fc6add1f32cc9fd1f12 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:56.928164  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb845b83c8c64fc6add1f32cc9fd1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.924942  4562 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.932116  4576 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.932391  4440 raft_consensus.cc:2393] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:56.932767  4576 raft_consensus.cc:697] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:56.933931  4576 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.935132  4557 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:56.935799  4557 ts_tablet_manager.cc:1403] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.300s	user 0.018s	sys 0.015s
I20260709 12:12:56.936245  4556 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:56.942940  4556 ts_tablet_manager.cc:1403] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.010s
I20260709 12:12:56.914877  4356 tablet_service.cc:1511] Processing CreateTablet for tablet cb845b83c8c64fc6add1f32cc9fd1f12 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:56.916227  4500 tablet_service.cc:1511] Processing CreateTablet for tablet cb845b83c8c64fc6add1f32cc9fd1f12 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:56.946327  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:56.946844  4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb845b83c8c64fc6add1f32cc9fd1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.947203  4365 raft_consensus.cc:2393] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:12:56.948777  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:56.958750  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb845b83c8c64fc6add1f32cc9fd1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.950752  4562 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:56.956053  4557 raft_consensus.cc:359] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:56.976850  4426 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28d6bc26fc4caeac04b56caf240716 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:56.978545  4426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28d6bc26fc4caeac04b56caf240716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.979542  4407 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:56.981774  4562 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.968385  4557 raft_consensus.cc:385] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.997155  4555 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:56.997714  4555 ts_tablet_manager.cc:1403] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.006s
I20260709 12:12:56.991858  4264 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.946864  4556 raft_consensus.cc:359] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.009614  4496 tablet_service.cc:1511] Processing CreateTablet for tablet 1f28d6bc26fc4caeac04b56caf240716 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:57.011003  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28d6bc26fc4caeac04b56caf240716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.011952  4430 tablet_service.cc:1511] Processing CreateTablet for tablet 2c050a61816f48f59f2cefc96a79621d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.013234  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c050a61816f48f59f2cefc96a79621d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.016049  4348 tablet_service.cc:1511] Processing CreateTablet for tablet 2c050a61816f48f59f2cefc96a79621d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.017336  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c050a61816f48f59f2cefc96a79621d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.992635  4557 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.007041  4556 raft_consensus.cc:385] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.034785  4504 tablet_service.cc:1511] Processing CreateTablet for tablet 2c050a61816f48f59f2cefc96a79621d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:57.026834  4556 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.046168  4556 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.073171  4499 tablet_service.cc:1511] Processing CreateTablet for tablet e9b9bc6664cb46d1b1ccf0965abab439 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.074651  4502 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb5c6cd99c34c058da3556e59e8e01c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.076725  4505 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.040691  4557 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.092294  4503 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0f779e13cd4398b4596cccced22d75 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.095536  4355 tablet_service.cc:1511] Processing CreateTablet for tablet e9b9bc6664cb46d1b1ccf0965abab439 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.096473  4347 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0f779e13cd4398b4596cccced22d75 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.098064  4501 tablet_service.cc:1511] Processing CreateTablet for tablet abf6bd6bb7324271871b60ca568cc852 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.099056  4351 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb5c6cd99c34c058da3556e59e8e01c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.100570  4354 tablet_service.cc:1511] Processing CreateTablet for tablet abf6bd6bb7324271871b60ca568cc852 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.102056  4422 tablet_service.cc:1511] Processing CreateTablet for tablet e9b9bc6664cb46d1b1ccf0965abab439 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:57.103590  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b9bc6664cb46d1b1ccf0965abab439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.100735  4423 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0f779e13cd4398b4596cccced22d75 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:57.096885  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b9bc6664cb46d1b1ccf0965abab439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.105685  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c050a61816f48f59f2cefc96a79621d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.106455  4555 raft_consensus.cc:359] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.107172  4555 raft_consensus.cc:385] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.107434  4555 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.108094  4555 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.108258  4425 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb5c6cd99c34c058da3556e59e8e01c (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:57.109175  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0f779e13cd4398b4596cccced22d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.112052  4354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf6bd6bb7324271871b60ca568cc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.112214  4499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b9bc6664cb46d1b1ccf0965abab439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.115775  4557 ts_tablet_manager.cc:1434] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.000s
I20260709 12:12:57.117511  4502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb5c6cd99c34c058da3556e59e8e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.123610  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.124739  4503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0f779e13cd4398b4596cccced22d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.127697  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf6bd6bb7324271871b60ca568cc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.138640  4431 tablet_service.cc:1511] Processing CreateTablet for tablet abf6bd6bb7324271871b60ca568cc852 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:57.139048  4427 tablet_service.cc:1511] Processing CreateTablet for tablet 0204e53e3fe3403ca1198afb918a0618 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:57.142745  4351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb5c6cd99c34c058da3556e59e8e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.144214  4349 tablet_service.cc:1511] Processing CreateTablet for tablet 0204e53e3fe3403ca1198afb918a0618 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:57.145539  4423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0f779e13cd4398b4596cccced22d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.147696  4350 tablet_service.cc:1511] Processing CreateTablet for tablet b524dfc86657460e8841456102df7e40 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:57.150797  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0204e53e3fe3403ca1198afb918a0618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.151626  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf6bd6bb7324271871b60ca568cc852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.167724  4497 tablet_service.cc:1511] Processing CreateTablet for tablet b524dfc86657460e8841456102df7e40 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:57.169158  4497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b524dfc86657460e8841456102df7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.170763  4429 tablet_service.cc:1511] Processing CreateTablet for tablet b524dfc86657460e8841456102df7e40 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:57.174574  4429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b524dfc86657460e8841456102df7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.176003  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.079452  4556 ts_tablet_manager.cc:1434] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.005s
I20260709 12:12:57.178462  4555 ts_tablet_manager.cc:1434] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.180s	user 0.006s	sys 0.000s
I20260709 12:12:57.179440  4555 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.180157  4428 tablet_service.cc:1511] Processing CreateTablet for tablet d0e2bd80ae11402a8a9e199424af5458 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:57.181326  4425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb5c6cd99c34c058da3556e59e8e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.182757  4352 tablet_service.cc:1511] Processing CreateTablet for tablet d0e2bd80ae11402a8a9e199424af5458 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:57.187724  4428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e2bd80ae11402a8a9e199424af5458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.145663  4349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0204e53e3fe3403ca1198afb918a0618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.164355  4424 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:57.205777  4563 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.209131  4556 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.214007  4424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.215513  4350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b524dfc86657460e8841456102df7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.244140  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.248883  4352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e2bd80ae11402a8a9e199424af5458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.254524  4562 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.216454  4555 tablet_bootstrap.cc:654] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.217337  4557 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.192031  4500 tablet_service.cc:1511] Processing CreateTablet for tablet 0204e53e3fe3403ca1198afb918a0618 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:57.233296  4348 tablet_service.cc:1511] Processing CreateTablet for tablet b42d741e25d64c56a067245eb7cb14c2 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:57.234359  4353 tablet_service.cc:1511] Processing CreateTablet for tablet 3568f45f51034aec8216f626ea0759ea (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:57.234972  4430 tablet_service.cc:1511] Processing CreateTablet for tablet 3568f45f51034aec8216f626ea0759ea (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:57.261381  4348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42d741e25d64c56a067245eb7cb14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.237530  4422 tablet_service.cc:1511] Processing CreateTablet for tablet b42d741e25d64c56a067245eb7cb14c2 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:57.262413  4353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3568f45f51034aec8216f626ea0759ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.259460  4556 tablet_bootstrap.cc:654] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.261381  4500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0204e53e3fe3403ca1198afb918a0618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.267151  4563 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.268065  4429 tablet_service.cc:1511] Processing CreateTablet for tablet f841988974fd4cd9a66ea124b9b9b284 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:57.274413  4356 tablet_service.cc:1511] Processing CreateTablet for tablet f841988974fd4cd9a66ea124b9b9b284 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:57.275988  4563 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.278584  4563 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.280485  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.281005  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.287539  4440 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
W20260709 12:12:57.284750  4407 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.289180  4332 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:57.290251  4563 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.290685  4563 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.291148  4563 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:57.297537  4467 tablet.cc:2406] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:57.282934  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841988974fd4cd9a66ea124b9b9b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.287590  4513 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:57.283324  4505 tablet_service.cc:1511] Processing CreateTablet for tablet d0e2bd80ae11402a8a9e199424af5458 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:57.303936  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e2bd80ae11402a8a9e199424af5458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.304596  4264 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.311302  4563 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.314193  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:57.314774  4440 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.326136  4504 tablet_service.cc:1511] Processing CreateTablet for tablet f841988974fd4cd9a66ea124b9b9b284 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:57.328575  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841988974fd4cd9a66ea124b9b9b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.335425  4429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841988974fd4cd9a66ea124b9b9b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.339418  4563 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.339512  4422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42d741e25d64c56a067245eb7cb14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.333427  4440 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:57.343710  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3568f45f51034aec8216f626ea0759ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.343967  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:57.344549  4513 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.351682  4332 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:57.352612  4589 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:57.356442  4332 consensus_peers.cc:597] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.357704  4557 tablet_bootstrap.cc:654] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.357394  4501 tablet_service.cc:1511] Processing CreateTablet for tablet 3568f45f51034aec8216f626ea0759ea (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:57.358371  4347 tablet_service.cc:1511] Processing CreateTablet for tablet c27395ba03b841e5969f26a9b223fe7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:57.358918  4501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3568f45f51034aec8216f626ea0759ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.359696  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27395ba03b841e5969f26a9b223fe7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.361402  4513 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:57.379623  4356 tablet_service.cc:1511] Processing CreateTablet for tablet c4f82f0bdef64f9787ddce96e1f85660 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:57.380829  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f82f0bdef64f9787ddce96e1f85660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.379623  4498 tablet_service.cc:1511] Processing CreateTablet for tablet b42d741e25d64c56a067245eb7cb14c2 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:57.384025  4505 tablet_service.cc:1511] Processing CreateTablet for tablet c27395ba03b841e5969f26a9b223fe7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:57.387384  4576 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.384584  4498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42d741e25d64c56a067245eb7cb14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.402526  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27395ba03b841e5969f26a9b223fe7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.409139  4496 tablet_service.cc:1511] Processing CreateTablet for tablet c4f82f0bdef64f9787ddce96e1f85660 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:57.410959  4496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f82f0bdef64f9787ddce96e1f85660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.433385  4556 tablet_bootstrap.cc:492] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:57.433962  4556 ts_tablet_manager.cc:1403] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.225s	user 0.020s	sys 0.028s
I20260709 12:12:57.435901  4589 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:57.457078  4576 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.457711  4576 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.458611  4430 tablet_service.cc:1511] Processing CreateTablet for tablet c27395ba03b841e5969f26a9b223fe7d (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:57.459883  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27395ba03b841e5969f26a9b223fe7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.460208  4576 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.458959  4589 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.462085  4427 tablet_service.cc:1511] Processing CreateTablet for tablet c4f82f0bdef64f9787ddce96e1f85660 (DEFAULT_TABLE table=test-workload [id=890fbdda236647258932aede70778cc8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:57.462532  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:12:57.464131  4481 leader_election.cc:343] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.468984  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:57.471135  4481 leader_election.cc:343] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.471642  4481 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.472944  4576 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.486461  4555 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.486931  4555 ts_tablet_manager.cc:1403] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.308s	user 0.021s	sys 0.027s
I20260709 12:12:57.489567  4555 raft_consensus.cc:359] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.490206  4557 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.490226  4555 raft_consensus.cc:385] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.490649  4555 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.490806  4557 ts_tablet_manager.cc:1403] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.274s	user 0.024s	sys 0.034s
I20260709 12:12:57.491345  4555 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.493337  4555 ts_tablet_manager.cc:1434] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:57.493700  4557 raft_consensus.cc:359] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.494221  4555 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.494400  4557 raft_consensus.cc:385] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.494678  4557 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.495536  4557 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.479889  4427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f82f0bdef64f9787ddce96e1f85660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.499101  4557 ts_tablet_manager.cc:1434] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:57.515956  4556 raft_consensus.cc:359] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.516754  4556 raft_consensus.cc:385] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.517081  4556 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.517786  4556 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.534123  4556 ts_tablet_manager.cc:1434] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 12:12:57.535321  4556 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.548620  4264 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.553661  4557 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.556583  4555 tablet_bootstrap.cc:654] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.562474  4556 tablet_bootstrap.cc:654] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.565129  4576 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:57.586721  4557 tablet_bootstrap.cc:654] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.588018  4555 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.588536  4555 ts_tablet_manager.cc:1403] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.011s
I20260709 12:12:57.591109  4555 raft_consensus.cc:359] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.591789  4555 raft_consensus.cc:385] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.592059  4555 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.592796  4555 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.594839  4555 ts_tablet_manager.cc:1434] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:57.596920  4555 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.597508  4556 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:57.598014  4556 ts_tablet_manager.cc:1403] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 12:12:57.601049  4556 raft_consensus.cc:359] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.601902  4556 raft_consensus.cc:385] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.602025  4555 tablet_bootstrap.cc:654] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.602237  4556 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.603129  4556 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.604266  4557 tablet_bootstrap.cc:492] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.604880  4557 ts_tablet_manager.cc:1403] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 12:12:57.609926  4557 raft_consensus.cc:359] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.610778  4557 raft_consensus.cc:385] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.611162  4557 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.611951  4557 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.614305  4557 ts_tablet_manager.cc:1434] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:57.612840  4556 ts_tablet_manager.cc:1434] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:12:57.616345  4557 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.616345  4556 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.623796  4557 tablet_bootstrap.cc:654] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.625941  4556 tablet_bootstrap.cc:654] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.628449  4555 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.629104  4555 ts_tablet_manager.cc:1403] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.015s
I20260709 12:12:57.632701  4555 raft_consensus.cc:359] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.633724  4555 raft_consensus.cc:385] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.634135  4555 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.635129  4555 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.638230  4555 ts_tablet_manager.cc:1434] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:57.641505  4555 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.645714  4557 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.646203  4557 ts_tablet_manager.cc:1403] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.011s
I20260709 12:12:57.646606  4556 tablet_bootstrap.cc:492] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:57.647171  4556 ts_tablet_manager.cc:1403] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.007s
I20260709 12:12:57.647959  4555 tablet_bootstrap.cc:654] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.648748  4557 raft_consensus.cc:359] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.649441  4557 raft_consensus.cc:385] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.649727  4557 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.650466  4556 raft_consensus.cc:359] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.650379  4557 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.651561  4556 raft_consensus.cc:385] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.651947  4556 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.653059  4556 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.657070  4556 ts_tablet_manager.cc:1434] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:12:57.658272  4556 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.661619  4557 ts_tablet_manager.cc:1434] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:57.662770  4557 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.665576  4556 tablet_bootstrap.cc:654] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.669413  4557 tablet_bootstrap.cc:654] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.670454  4576 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.671032  4576 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.673629  4576 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.675621  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.675849  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:57.677263  4481 leader_election.cc:343] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.677929  4481 leader_election.cc:343] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.678357  4481 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.679405  4576 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.681141  4576 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.681619  4576 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.682467  4555 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.682898  4555 ts_tablet_manager.cc:1403] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.021s
I20260709 12:12:57.683063  4557 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.683476  4557 ts_tablet_manager.cc:1403] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:12:57.684031  4576 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.685238  4556 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:57.685725  4556 ts_tablet_manager.cc:1403] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 12:12:57.685776  4557 raft_consensus.cc:359] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.686512  4557 raft_consensus.cc:385] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.686440  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.685532  4555 raft_consensus.cc:359] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.687208  4555 raft_consensus.cc:385] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.687551  4555 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.686851  4557 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.687523  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:12:57.688062  4481 leader_election.cc:343] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.688798  4556 raft_consensus.cc:359] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.688715  4555 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:57.689314  4481 leader_election.cc:343] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.689574  4556 raft_consensus.cc:385] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.689356  4557 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.689982  4556 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.689921  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.691082  4556 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.691919  4589 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.692121  4557 ts_tablet_manager.cc:1434] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:57.692623  4576 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.692411  4589 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.694235  4555 ts_tablet_manager.cc:1434] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:12:57.695358  4555 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.696300  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.697003  4440 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:57.698846  4557 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.699414  4332 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:57.700525  4607 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.700973  4607 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.701367  4607 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.702121  4555 tablet_bootstrap.cc:654] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.706061  4557 tablet_bootstrap.cc:654] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.708854  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.709609  4515 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:57.711370  4589 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.714884  4607 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.718433  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:57.719134  4440 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.727398  4440 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:57.727867  4576 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.729034  4576 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.731029  4557 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.731532  4557 ts_tablet_manager.cc:1403] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.014s
I20260709 12:12:57.733175  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.734526  4557 raft_consensus.cc:359] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.735303  4557 raft_consensus.cc:385] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:57.735127  4481 leader_election.cc:343] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.735693  4557 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.736580  4557 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.739125  4557 ts_tablet_manager.cc:1434] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:57.739024  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.740253  4557 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.740990  4556 ts_tablet_manager.cc:1434] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
W20260709 12:12:57.743999  4481 leader_election.cc:343] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.747253  4481 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.748605  4611 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.736702  4576 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.746578  4557 tablet_bootstrap.cc:654] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.750447  4556 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.752912  4332 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:57.754207  4589 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.754926  4589 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:57.756028  4555 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.756570  4555 ts_tablet_manager.cc:1403] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.032s
I20260709 12:12:57.756493  4589 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.758193  4556 tablet_bootstrap.cc:654] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.759439  4576 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.759939  4576 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.762269  4576 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.763137  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.763630  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.764286  4440 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
W20260709 12:12:57.764796  4481 leader_election.cc:343] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.764395  4555 raft_consensus.cc:359] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.765663  4481 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.766626  4576 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.765687  4555 raft_consensus.cc:385] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.767109  4557 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.767197  4576 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.767640  4557 ts_tablet_manager.cc:1403] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 12:12:57.767915  4576 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.769884  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:57.770522  4515 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.770844  4557 raft_consensus.cc:359] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.771574  4557 raft_consensus.cc:385] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.771870  4557 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.772687  4557 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.767321  4555 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.775818  4555 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.776636  4607 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.778326  4557 ts_tablet_manager.cc:1434] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:57.780779  4515 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:57.781441  4557 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.788332  4557 tablet_bootstrap.cc:654] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.790454  4555 ts_tablet_manager.cc:1434] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:12:57.790041  4262 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.791783  4555 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:57.798187  4576 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.802209  4576 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:57.804324  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:57.804602  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:57.805434  4440 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:57.806380  4481 leader_election.cc:343] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:57.810207  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:57.821501  4562 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.822453  4556 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:57.822355  4562 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.823222  4556 ts_tablet_manager.cc:1403] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.018s
I20260709 12:12:57.824265  4440 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:57.824584  4562 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.826592  4481 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.827800  4576 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.827262  4556 raft_consensus.cc:359] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.828105  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.828395  4576 raft_consensus.cc:697] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:57.828589  4556 raft_consensus.cc:385] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.829041  4556 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.829330  4576 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.831794  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.833545  4407 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:57.834412  4557 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.834704  4562 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:57.834905  4557 ts_tablet_manager.cc:1403] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.054s	user 0.036s	sys 0.015s
I20260709 12:12:57.835984  4440 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.837918  4557 raft_consensus.cc:359] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.838646  4557 raft_consensus.cc:385] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.838555  4555 tablet_bootstrap.cc:654] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.839164  4557 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.840163  4557 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.830161  4556 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.846159  4557 ts_tablet_manager.cc:1434] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:57.847394  4557 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.849393  4589 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:57.852767  4556 ts_tablet_manager.cc:1434] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:12:57.853919  4556 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:57.860818  4557 tablet_bootstrap.cc:654] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.873180  4556 tablet_bootstrap.cc:654] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.872270  4262 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.885033  4562 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.885547  4562 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.888669  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.889299  4515 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:57.890482  4406 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:57.891570  4595 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.892138  4595 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.892408  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.892635  4595 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.891598  4607 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 12:12:57.900064  4407 leader_election.cc:343] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.894091  4562 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.904501  4365 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.907980  4555 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:57.908521  4555 ts_tablet_manager.cc:1403] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.008s
I20260709 12:12:57.908897  4595 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.912521  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:57.914604  4557 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.915117  4557 ts_tablet_manager.cc:1403] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.008s
W20260709 12:12:57.915349  4407 leader_election.cc:343] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.916069  4562 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.916630  4562 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.917755  4557 raft_consensus.cc:359] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.918430  4557 raft_consensus.cc:385] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.918691  4557 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.919577  4557 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.920003  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:57.920583  4363 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:57.920940  4555 raft_consensus.cc:359] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.921738  4557 ts_tablet_manager.cc:1434] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:57.921981  4555 raft_consensus.cc:385] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.922075  4407 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:57.922703  4557 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.923061  4569 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:57.923635  4569 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.924114  4569 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.925236  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:57.925849  4515 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.928426  4562 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.928812  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.929770  4513 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:57.933714  4515 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:57.934475  4595 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.922511  4555 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.939520  4607 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.943336  4607 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.943869  4555 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.945484  4607 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.945959  4555 ts_tablet_manager.cc:1434] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:12:57.940671  4406 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:57.947198  4595 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.947697  4595 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:57.948513  4595 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.949159  4569 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.950529  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:57.950958  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:57.951361  4515 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:12:57.951705  4440 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:57.942078  4557 tablet_bootstrap.cc:654] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.954299  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:57.955096  4515 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.956583  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:57.958200  4607 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.963204  4569 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:57.966564  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:57.967478  4363 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:57.964432  4515 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:57.971763  4406 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:57.973265  4569 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:57.974066  4569 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:57.975505  4569 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.985714  4557 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:57.986244  4557 ts_tablet_manager.cc:1403] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.008s
I20260709 12:12:57.988988  4557 raft_consensus.cc:359] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.989678  4557 raft_consensus.cc:385] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:57.989971  4557 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:57.990623  4557 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.992645  4557 ts_tablet_manager.cc:1434] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:12:57.993583  4557 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:57.996876  4569 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.997550  4569 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:57.997870  4262 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:57.999607  4557 tablet_bootstrap.cc:654] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:57.999508  4363 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:58.001374  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.002041  4515 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:58.003374  4406 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.005266  4607 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.006050  4569 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.006239  4562 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.006577  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.006807  4562 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.007359  4562 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:58.008174  4407 leader_election.cc:343] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:57.946892  4555 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.022589  4262 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.046095  4563 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.047526  4563 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.054078  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.055277  4440 raft_consensus.cc:2393] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:12:58.055810  4562 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.057917  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.050447  4563 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.063105  4556 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.063210  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:58.064054  4556 ts_tablet_manager.cc:1403] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.211s	user 0.056s	sys 0.098s
I20260709 12:12:58.067122  4513 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.067343  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.067780  4556 raft_consensus.cc:359] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.068730  4556 raft_consensus.cc:385] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.069169  4556 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.071079  4556 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.068590  4562 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.073598  4331 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:12:58.075238  4407 leader_election.cc:343] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.075946  4563 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.079984  4513 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:58.081871  4556 ts_tablet_manager.cc:1434] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:12:58.082203  4406 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.082891  4556 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.083660  4562 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.084336  4562 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:58.085697  4607 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:12:58.085501  4562 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.086200  4607 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.088603  4557 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.089066  4557 ts_tablet_manager.cc:1403] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.096s	user 0.032s	sys 0.041s
I20260709 12:12:58.089555  4563 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.092419  4557 raft_consensus.cc:359] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.093369  4557 raft_consensus.cc:385] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.093689  4556 tablet_bootstrap.cc:654] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.093724  4557 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.094823  4557 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.096796  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.097414  4557 ts_tablet_manager.cc:1434] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:12:58.098657  4557 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.098731  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.102926  4331 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.104837  4563 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:58.094759  4607 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.120340  4557 tablet_bootstrap.cc:654] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.120025  4262 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.125932  4555 tablet_bootstrap.cc:654] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.135547  4556 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.136040  4556 ts_tablet_manager.cc:1403] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.017s
I20260709 12:12:58.136873  4557 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.137509  4557 ts_tablet_manager.cc:1403] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.013s
I20260709 12:12:58.139765  4556 raft_consensus.cc:359] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.140427  4556 raft_consensus.cc:385] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.140762  4556 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.141426  4556 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.143478  4563 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.143774  4556 ts_tablet_manager.cc:1434] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:58.144001  4563 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.144701  4556 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.147166  4555 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.147591  4555 ts_tablet_manager.cc:1403] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.003s
I20260709 12:12:58.148139  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.149185  4513 raft_consensus.cc:2393] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:58.150195  4555 raft_consensus.cc:359] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.151299  4563 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.151628  4637 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.140439  4557 raft_consensus.cc:359] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.152674  4557 raft_consensus.cc:385] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.152144  4637 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.153127  4557 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.154044  4557 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.156751  4557 ts_tablet_manager.cc:1434] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:12:58.156857  4611 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.157444  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.157358  4611 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.157814  4557 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.158138  4513 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:58.159511  4406 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.160427  4562 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.160785  4562 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.161114  4562 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.163295  4569 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.163894  4569 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.165032  4557 tablet_bootstrap.cc:654] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.166579  4569 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.168551  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.150893  4555 raft_consensus.cc:385] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.175418  4555 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.168509  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.169292  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.175738  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.176308  4513 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:58.176528  4441 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.177649  4406 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.178614  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.178977  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.180029  4563 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.180279  4556 tablet_bootstrap.cc:654] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.170143  4576 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.172081  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.154908  4637 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.173405  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.176463  4555 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.169762  4611 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.180881  4576 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.187384  4646 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:58.181147  4407 leader_election.cc:343] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.180047  4569 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.190784  4646 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.194407  4646 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:58.189175  4364 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.194963  4562 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.201639  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:58.202229  4513 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.202708  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.190248  4611 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.206382  4611 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.190943  4569 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.207293  4569 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.208554  4611 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.214574  4576 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:12:58.210443  4407 leader_election.cc:343] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.211503  4562 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:12:58.217792  4407 leader_election.cc:343] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.222195  4557 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.234490  4557 ts_tablet_manager.cc:1403] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.077s	user 0.029s	sys 0.017s
I20260709 12:12:58.223119  4569 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.228068  4513 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:58.237247  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.239717  4563 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.239713  4406 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.241219  4562 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.241708  4562 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:58.242547  4562 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.244434  4555 ts_tablet_manager.cc:1434] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.097s	user 0.023s	sys 0.002s
I20260709 12:12:58.245720  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.247429  4555 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.248227  4646 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.249183  4556 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.248799  4557 raft_consensus.cc:359] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.249581  4557 raft_consensus.cc:385] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.249668  4556 ts_tablet_manager.cc:1403] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.004s
I20260709 12:12:58.249923  4557 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.250089  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.250458  4646 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.250735  4364 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:58.245827  4563 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.252916  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.253528  4441 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:58.254300  4569 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.251060  4557 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.255812  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:58.256410  4515 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.256731  4557 ts_tablet_manager.cc:1434] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:12:58.256906  4563 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.257707  4557 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
W20260709 12:12:58.259418  4481 leader_election.cc:343] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.260133  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.261261  4637 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.260535  4556 raft_consensus.cc:359] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.261955  4556 raft_consensus.cc:385] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.261765  4637 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.262266  4556 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.264169  4637 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:12:58.265483  4481 leader_election.cc:343] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.265925  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.266096  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.266848  4648 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.267316  4648 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.267688  4648 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.267562  4556 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.268749  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.269353  4365 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:58.271534  4557 tablet_bootstrap.cc:654] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:58.271833  4407 leader_election.cc:343] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.274111  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.274471  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:58.274107  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.275027  4440 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:58.279731  4407 leader_election.cc:343] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.280531  4406 leader_election.cc:343] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.281023  4406 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.281849  4569 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.282730  4556 ts_tablet_manager.cc:1434] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:12:58.284993  4648 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.287688  4440 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:12:58.267302  4647 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.289855  4515 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:58.291833  4406 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.292786  4569 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.293251  4569 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:58.294076  4569 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.294965  4555 tablet_bootstrap.cc:654] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.295509  4556 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.302408  4365 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:12:58.307109  4647 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.309020  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.312742  4648 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.313445  4576 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:58.313961  4576 raft_consensus.cc:697] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:58.314980  4576 consensus_queue.cc:237] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.320727  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.321353  4365 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.327605  4263 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.330785  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:58.331431  4440 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.338265  4440 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.344105  4555 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.344683  4555 ts_tablet_manager.cc:1403] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.000s
I20260709 12:12:58.347097  4555 raft_consensus.cc:359] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.347810  4555 raft_consensus.cc:385] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.348094  4555 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.348073  4562 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.348693  4562 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.352763  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:12:58.354389  4407 leader_election.cc:343] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.355888  4365 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.359198  4557 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.359738  4557 ts_tablet_manager.cc:1403] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.045s
I20260709 12:12:58.359738  4556 tablet_bootstrap.cc:654] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.362792  4557 raft_consensus.cc:359] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.363467  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.372119  4576 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.372658  4576 raft_consensus.cc:697] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:58.364331  4555 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.365577  4263 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.373546  4576 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.367357  4562 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.367980  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.370817  4569 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:58.384330  4406 leader_election.cc:343] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.384814  4611 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.385378  4555 ts_tablet_manager.cc:1434] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:12:58.386438  4555 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.388585  4264 catalog_manager.cc:5697] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 2, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.384999  4406 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.408782  4562 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.411651  4557 raft_consensus.cc:385] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.412065  4557 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.413354  4562 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.420866  4557 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.429934  4557 ts_tablet_manager.cc:1434] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:12:58.433863  4557 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.440080  4569 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.448042  4557 tablet_bootstrap.cc:654] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.467412  4562 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.467994  4562 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.471642  4569 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.484164  4555 tablet_bootstrap.cc:654] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.487151  4264 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.491848  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:12:58.493793  4406 leader_election.cc:343] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.495720  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.492154  4556 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.497270  4556 ts_tablet_manager.cc:1403] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.202s	user 0.039s	sys 0.028s
I20260709 12:12:58.491694  4562 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.513728  4557 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
W20260709 12:12:58.497676  4407 leader_election.cc:343] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.514595  4407 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.515878  4562 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.517714  4557 ts_tablet_manager.cc:1403] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.031s
I20260709 12:12:58.501019  4556 raft_consensus.cc:359] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.521476  4557 raft_consensus.cc:359] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.521919  4556 raft_consensus.cc:385] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.522310  4557 raft_consensus.cc:385] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.522286  4556 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.522799  4557 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.523227  4556 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.523649  4557 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.525393  4556 ts_tablet_manager.cc:1434] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.006s
I20260709 12:12:58.526180  4557 ts_tablet_manager.cc:1434] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:58.526294  4556 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.527264  4557 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.527194  4607 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.528012  4607 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.532137  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.533108  4556 tablet_bootstrap.cc:654] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.534206  4557 tablet_bootstrap.cc:654] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.535145  4607 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.543278  4557 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.543593  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.543967  4557 ts_tablet_manager.cc:1403] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:12:58.544412  4513 raft_consensus.cc:2393] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:58.546819  4331 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.547914  4557 raft_consensus.cc:359] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.548736  4557 raft_consensus.cc:385] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.549114  4557 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.550364  4607 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.549862  4557 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.553268  4557 ts_tablet_manager.cc:1434] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:12:58.554607  4557 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.557806  4607 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.563818  4557 tablet_bootstrap.cc:654] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.565834  4555 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.567135  4555 ts_tablet_manager.cc:1403] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.181s	user 0.027s	sys 0.022s
I20260709 12:12:58.570930  4555 raft_consensus.cc:359] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.572155  4555 raft_consensus.cc:385] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.572567  4555 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.573693  4555 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.577539  4555 ts_tablet_manager.cc:1434] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:12:58.581490  4555 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.582331  4556 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.582849  4556 ts_tablet_manager.cc:1403] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.005s
I20260709 12:12:58.585616  4556 raft_consensus.cc:359] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.586315  4556 raft_consensus.cc:385] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.586628  4556 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.587328  4556 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.588483  4555 tablet_bootstrap.cc:654] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.589639  4556 ts_tablet_manager.cc:1434] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:58.593216  4556 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.595410  4557 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:58.596084  4557 ts_tablet_manager.cc:1403] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.008s
I20260709 12:12:58.599234  4556 tablet_bootstrap.cc:654] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.599403  4557 raft_consensus.cc:359] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.600211  4557 raft_consensus.cc:385] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.600386  4555 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.600622  4557 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.600898  4555 ts_tablet_manager.cc:1403] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:12:58.601400  4557 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.603787  4557 ts_tablet_manager.cc:1434] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:58.603708  4555 raft_consensus.cc:359] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.604537  4555 raft_consensus.cc:385] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.604861  4555 raft_consensus.cc:740] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.605882  4555 consensus_queue.cc:260] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.607712  4557 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.612157  4555 ts_tablet_manager.cc:1434] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:58.613246  4555 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.614414  4557 tablet_bootstrap.cc:654] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.620080  4555 tablet_bootstrap.cc:654] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.622386  4562 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.624094  4569 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.624574  4569 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.626814  4569 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.628190  4556 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.628417  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.629009  4556 ts_tablet_manager.cc:1403] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.010s
I20260709 12:12:58.629139  4515 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:58.629657  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.624531  4562 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:58.631078  4407 leader_election.cc:343] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.634234  4406 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.633713  4556 raft_consensus.cc:359] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.634848  4556 raft_consensus.cc:385] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.638893  4556 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.636715  4562 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.639299  4365 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.640012  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.639762  4556 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.640815  4555 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.641304  4555 ts_tablet_manager.cc:1403] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260709 12:12:58.642091  4556 ts_tablet_manager.cc:1434] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:12:58.642875  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.643153  4556 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
W20260709 12:12:58.645798  4406 leader_election.cc:343] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.635031  4569 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.645960  4555 raft_consensus.cc:359] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.646813  4569 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.637449  4557 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
W20260709 12:12:58.649170  4407 leader_election.cc:343] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.646878  4555 raft_consensus.cc:385] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.649654  4557 ts_tablet_manager.cc:1403] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.006s
I20260709 12:12:58.649737  4556 tablet_bootstrap.cc:654] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.649708  4407 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.649968  4555 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.651049  4555 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.651660  4562 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.652943  4562 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.652726  4557 raft_consensus.cc:359] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.653802  4557 raft_consensus.cc:385] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.654160  4557 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.654472  4555 ts_tablet_manager.cc:1434] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:12:58.655654  4555 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.656042  4569 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.657567  4576 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.658098  4576 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.660401  4576 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.662611  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:12:58.664381  4481 leader_election.cc:343] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.665776  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.666288  4556 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.666515  4441 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:58.666778  4556 ts_tablet_manager.cc:1403] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.013s
I20260709 12:12:58.668505  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.670087  4556 raft_consensus.cc:359] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.671861  4562 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.672775  4555 tablet_bootstrap.cc:654] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.675097  4556 raft_consensus.cc:385] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.676034  4576 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.676055  4556 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.676683  4576 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.677232  4576 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.677397  4556 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.680438  4556 ts_tablet_manager.cc:1434] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:12:58.682650  4556 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.655162  4557 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.691778  4562 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.696769  4556 tablet_bootstrap.cc:654] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.697505  4555 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.705634  4555 ts_tablet_manager.cc:1403] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.005s
I20260709 12:12:58.709378  4555 raft_consensus.cc:359] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.710311  4555 raft_consensus.cc:385] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.710748  4555 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.711603  4555 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.713642  4576 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.715189  4555 ts_tablet_manager.cc:1434] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:12:58.716490  4555 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.716429  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.690830  4569 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.717216  4365 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.716331  4595 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:58.720952  4576 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.733386  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:58.734350  4441 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.742486  4365 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.745936  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:58.747058  4648 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.747637  4648 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.764683  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.770378  4576 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.772056  4576 raft_consensus.cc:697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:58.772977  4576 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.776136  4441 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.776542  4556 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:58.777546  4556 ts_tablet_manager.cc:1403] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.006s
I20260709 12:12:58.780480  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:12:58.781136  4481 leader_election.cc:343] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:58.781950  4407 leader_election.cc:343] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.782653  4556 raft_consensus.cc:359] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.783569  4556 raft_consensus.cc:385] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.784845  4556 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.783905  4648 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.785764  4569 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.787717  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:58.788403  4515 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.789479  4555 tablet_bootstrap.cc:654] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.790426  4363 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:58.792021  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.795109  4440 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:58.785995  4556 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.796017  4555 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:58.796654  4555 ts_tablet_manager.cc:1403] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.010s
I20260709 12:12:58.797888  4440 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:58.793816  4557 ts_tablet_manager.cc:1434] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.144s	user 0.016s	sys 0.000s
I20260709 12:12:58.799665  4481 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.801126  4611 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.803243  4648 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.803871  4648 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.807211  4648 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.799881  4557 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:58.813882  4607 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.814368  4607 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.816592  4607 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.818933  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.819350  4556 ts_tablet_manager.cc:1434] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:12:58.819785  4513 raft_consensus.cc:2393] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:58.820329  4556 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:58.821732  4611 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:58.823949  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.825266  4515 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:58.825969  4332 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.826486  4406 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.827216  4607 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.827792  4677 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.828307  4677 raft_consensus.cc:697] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:58.829181  4677 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.810672  4555 raft_consensus.cc:359] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.832023  4555 raft_consensus.cc:385] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:58.832372  4555 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:58.834692  4611 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.835321  4611 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.838112  4611 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.839255  4555 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.840665  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.842340  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:58.844993  4481 leader_election.cc:343] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.845484  4441 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:58.846940  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.848585  4647 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.849006  4647 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.849375  4647 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.850055  4607 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:58.850288  4555 ts_tablet_manager.cc:1434] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.004s
I20260709 12:12:58.856426  4555 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:58.865347  4562 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.860432  4648 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.878530  4557 tablet_bootstrap.cc:654] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.879772  4647 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.882091  4647 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:12:58.883208  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:58.884413  4262 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:58.889636  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.890552  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:58.891360  4441 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.902531  4263 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.912094  4562 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.912911  4562 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:58.903294  4481 leader_election.cc:343] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.922712  4677 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:58.929719  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.933000  4607 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.933579  4607 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.936007  4556 tablet_bootstrap.cc:654] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:58.936589  4406 leader_election.cc:343] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.937321  4648 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.939404  4607 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.941596  4562 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:58.942823  4555 tablet_bootstrap.cc:654] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:58.949781  4441 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:58.953526  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:58.960217  4439 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:58.958715  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:58.966651  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:58.967433  4363 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:58.976075  4332 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:12:58.981874  4331 leader_election.cc:343] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:58.985044  4684 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.985147  4407 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:58.985532  4684 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.990880  4677 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.991065  4684 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:58.991412  4677 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.991840  4677 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.992197  4589 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:58.992195  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:58.992712  4589 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.992877  4441 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.993098  4589 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:58.993851  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:58.996666  4684 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.997051  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:58.997128  4684 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:58.999208  4576 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:58.999765  4576 raft_consensus.cc:697] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.000571  4576 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.003228  4611 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.003808  4611 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.005995  4611 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.012257  4684 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.015231  4677 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.021440  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.024909  4562 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.028538  4562 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.015183  4589 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.035888  4562 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.037158  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.037899  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:12:59.038600  4406 leader_election.cc:343] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.040499  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.040745  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.043296  4555 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.043908  4440 raft_consensus.cc:2393] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:59.044440  4555 ts_tablet_manager.cc:1403] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.188s	user 0.016s	sys 0.000s
I20260709 12:12:59.043412  4439 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.047070  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:12:59.051695  4406 leader_election.cc:343] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.041772  4677 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:12:59.051821  4481 leader_election.cc:343] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.060804  4481 leader_election.cc:343] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.061861  4576 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:59.063335  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.065088  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.065414  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.065650  4611 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.066202  4366 raft_consensus.cc:2393] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:12:59.066053  4611 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.066015  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.066751  4611 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.064184  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.067818  4440 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.063160  4589 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.066452  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.068231  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:59.070437  4441 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.068590  4556 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.064143  4555 raft_consensus.cc:359] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.071957  4555 raft_consensus.cc:385] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.061653  4557 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.072153  4556 ts_tablet_manager.cc:1403] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.252s	user 0.021s	sys 0.001s
I20260709 12:12:59.072739  4557 ts_tablet_manager.cc:1403] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.273s	user 0.016s	sys 0.001s
W20260709 12:12:59.075321  4407 leader_election.cc:343] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.075569  4556 raft_consensus.cc:359] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.075834  4407 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.076038  4557 raft_consensus.cc:359] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.076458  4556 raft_consensus.cc:385] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.076730  4557 raft_consensus.cc:385] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.076876  4556 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.077105  4557 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.077334  4407 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.078167  4562 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.078495  4677 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.078269  4556 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.072297  4555 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.074525  4611 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:59.079929  4481 leader_election.cc:343] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.080084  4555 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.081137  4513 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.081308  4481 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.082022  4557 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.082511  4576 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.084563  4576 raft_consensus.cc:697] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.085753  4557 ts_tablet_manager.cc:1434] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:12:59.085402  4576 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.083511  4481 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:59.081482  4611 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.084103  4556 ts_tablet_manager.cc:1434] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:59.087177  4684 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.096906  4684 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.097353  4684 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.100097  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.105641  4684 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:59.089404  4481 leader_election.cc:343] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.109431  4481 leader_election.cc:343] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.109884  4481 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.089860  4557 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.091385  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.111572  4441 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.116039  4481 leader_election.cc:343] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.119982  4557 tablet_bootstrap.cc:654] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.121956  4441 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.123114  4611 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.123587  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.089087  4513 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:59.125300  4647 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.125895  4647 raft_consensus.cc:697] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.126847  4647 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.129628  4555 ts_tablet_manager.cc:1434] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 12:12:59.131400  4555 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.108235  4556 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.144251  4684 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.138864  4555 tablet_bootstrap.cc:654] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.165633  4556 tablet_bootstrap.cc:654] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.150352  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.151206  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.155094  4648 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.169018  4441 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.157752  4557 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.170125  4557 ts_tablet_manager.cc:1403] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.000s
I20260709 12:12:59.172807  4557 raft_consensus.cc:359] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.173233  4555 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.173472  4557 raft_consensus.cc:385] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.173790  4557 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.173894  4555 ts_tablet_manager.cc:1403] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 12:12:59.176465  4441 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.176991  4557 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.177485  4555 raft_consensus.cc:359] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.178303  4555 raft_consensus.cc:385] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.178630  4555 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.179128  4557 ts_tablet_manager.cc:1434] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:59.179438  4331 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:12:59.179491  4555 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.180104  4557 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.180744  4589 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.181233  4589 raft_consensus.cc:697] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:59.182363  4555 ts_tablet_manager.cc:1434] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:59.182061  4589 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.183383  4555 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.189420  4607 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.189921  4607 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.192147  4607 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.192481  4557 tablet_bootstrap.cc:654] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.192682  4595 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.193138  4595 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.193712  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.193971  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.194396  4513 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:59.192435  4555 tablet_bootstrap.cc:654] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.195282  4595 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:12:59.195950  4332 leader_election.cc:343] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.196017  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.197268  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:12:59.198607  4406 leader_election.cc:343] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.198681  4481 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:12:59.199399  4407 leader_election.cc:343] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.199539  4331 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:12:59.199985  4407 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.200227  4589 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.201422  4689 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.201857  4689 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.201701  4589 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.202276  4689 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.201419  4595 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.209810  4555 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.210458  4555 ts_tablet_manager.cc:1403] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 12:12:59.211642  4589 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.211825  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.213148  4513 raft_consensus.cc:2393] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:12:59.215685  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.217988  4332 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.219650  4589 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.225706  4481 leader_election.cc:343] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.228084  4647 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.228801  4647 raft_consensus.cc:697] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.229904  4647 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.232764  4555 raft_consensus.cc:359] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.234352  4557 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.249001  4589 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.249714  4557 ts_tablet_manager.cc:1403] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.070s	user 0.030s	sys 0.019s
I20260709 12:12:59.238685  4555 raft_consensus.cc:385] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.241178  4689 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.241379  4262 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.250165  4555 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.250922  4555 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.252538  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.252480  4557 raft_consensus.cc:359] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.253358  4557 raft_consensus.cc:385] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.253641  4557 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
W20260709 12:12:59.254060  4332 leader_election.cc:343] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.254591  4555 ts_tablet_manager.cc:1434] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 12:12:59.254278  4557 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.255614  4555 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.256398  4557 ts_tablet_manager.cc:1434] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:59.257328  4557 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.257855  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:59.258447  4513 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.259871  4689 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.263029  4555 tablet_bootstrap.cc:654] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.263204  4557 tablet_bootstrap.cc:654] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.243412  4556 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.245132  4261 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.237884  4595 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.268047  4556 ts_tablet_manager.cc:1403] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.160s	user 0.025s	sys 0.007s
I20260709 12:12:59.270032  4261 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.271723  4513 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:59.273737  4331 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:12:59.275254  4689 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.274917  4556 raft_consensus.cc:359] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.275731  4556 raft_consensus.cc:385] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.275774  4689 raft_consensus.cc:697] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:59.276106  4556 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.276695  4689 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.285717  4556 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.287025  4647 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.287495  4557 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.288533  4557 ts_tablet_manager.cc:1403] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.004s
I20260709 12:12:59.291283  4557 raft_consensus.cc:359] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.292348  4557 raft_consensus.cc:385] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.292678  4557 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.293573  4557 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.296078  4557 ts_tablet_manager.cc:1434] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:59.297016  4557 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.308226  4557 tablet_bootstrap.cc:654] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.309284  4555 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.309780  4555 ts_tablet_manager.cc:1403] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.054s	user 0.002s	sys 0.009s
I20260709 12:12:59.312412  4555 raft_consensus.cc:359] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.313107  4555 raft_consensus.cc:385] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.313385  4555 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.314114  4555 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.313805  4261 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.316038  4557 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.316350  4556 ts_tablet_manager.cc:1434] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:12:59.316471  4557 ts_tablet_manager.cc:1403] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:12:59.318171  4607 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.318645  4607 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.320082  4595 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.320700  4607 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.322968  4556 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.325757  4557 raft_consensus.cc:359] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.326433  4557 raft_consensus.cc:385] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.326725  4557 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.327615  4557 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.329620  4555 ts_tablet_manager.cc:1434] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:12:59.330031  4557 ts_tablet_manager.cc:1434] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:12:59.330453  4595 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.330621  4555 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.330932  4557 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.330930  4595 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.335291  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.337738  4595 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.337893  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.339687  4556 tablet_bootstrap.cc:654] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.346467  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:12:59.346710  4407 leader_election.cc:343] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.342535  4262 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:59.349802  4406 leader_election.cc:343] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.349660  4262 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.350435  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.352257  4569 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.357038  4555 tablet_bootstrap.cc:654] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.360713  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.361500  4440 raft_consensus.cc:2393] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:12:59.366935  4557 tablet_bootstrap.cc:654] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.371196  4611 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.371651  4332 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.372973  4711 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.380781  4711 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.382388  4555 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.382843  4555 ts_tablet_manager.cc:1403] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.005s
I20260709 12:12:59.385402  4555 raft_consensus.cc:359] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.386049  4555 raft_consensus.cc:385] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.386292  4555 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.387039  4555 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.389807  4555 ts_tablet_manager.cc:1434] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:59.390846  4555 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.392571  4556 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.393507  4556 ts_tablet_manager.cc:1403] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.004s
I20260709 12:12:59.396066  4556 raft_consensus.cc:359] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.396696  4555 tablet_bootstrap.cc:654] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.396788  4556 raft_consensus.cc:385] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.397039  4557 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.397337  4556 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.397569  4557 ts_tablet_manager.cc:1403] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.005s
I20260709 12:12:59.398221  4556 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.400571  4556 ts_tablet_manager.cc:1434] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:59.400449  4557 raft_consensus.cc:359] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.401131  4557 raft_consensus.cc:385] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.401432  4557 raft_consensus.cc:740] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.401965  4556 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.402076  4557 consensus_queue.cc:260] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.408540  4556 tablet_bootstrap.cc:654] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.414566  4555 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.415086  4555 ts_tablet_manager.cc:1403] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 12:12:59.418045  4555 raft_consensus.cc:359] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.419778  4557 ts_tablet_manager.cc:1434] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:12:59.420672  4555 raft_consensus.cc:385] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.421033  4555 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.421844  4555 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.424301  4557 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.428704  4576 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.434691  4611 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.435258  4611 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.435940  4646 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.436429  4646 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.437721  4611 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.438167  4646 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.439100  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.439869  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.440567  4441 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.442051  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.443809  4557 tablet_bootstrap.cc:654] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.444789  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:59.446523  4481 leader_election.cc:343] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.447530  4481 leader_election.cc:343] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.448452  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.449240  4611 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.449625  4611 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.449970  4611 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.450162  4556 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.450697  4556 ts_tablet_manager.cc:1403] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.049s	user 0.032s	sys 0.012s
I20260709 12:12:59.450788  4555 ts_tablet_manager.cc:1434] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 12:12:59.451938  4555 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.453984  4556 raft_consensus.cc:359] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.454727  4556 raft_consensus.cc:385] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.455061  4556 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.455875  4556 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:59.459980  4481 leader_election.cc:343] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.460438  4481 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.460923  4556 ts_tablet_manager.cc:1434] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:59.461292  4557 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.461793  4557 ts_tablet_manager.cc:1403] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 12:12:59.461885  4556 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.464742  4557 raft_consensus.cc:359] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.467502  4557 raft_consensus.cc:385] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.467712  4557 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.468319  4557 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.469336  4576 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.470399  4595 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.470849  4595 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.471288  4557 ts_tablet_manager.cc:1434] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:59.472990  4557 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.474061  4595 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.472083  4611 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.476271  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:12:59.479135  4406 leader_election.cc:343] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.477020  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.476778  4555 tablet_bootstrap.cc:654] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.479820  4366 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:59.479305  4556 tablet_bootstrap.cc:654] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.481168  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.483723  4557 tablet_bootstrap.cc:654] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.487694  4595 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.488199  4595 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.488636  4595 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.497763  4611 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.502844  4595 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.506520  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.507162  4440 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.509087  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:12:59.510560  4406 leader_election.cc:343] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.511420  4595 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.511461  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.512128  4363 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.516856  4557 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.517329  4557 ts_tablet_manager.cc:1403] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.000s
I20260709 12:12:59.517563  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.518189  4555 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.518687  4555 ts_tablet_manager.cc:1403] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.006s
I20260709 12:12:59.518129  4366 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.519057  4481 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.520583  4557 raft_consensus.cc:359] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.521238  4557 raft_consensus.cc:385] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.521500  4557 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.522423  4556 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.522132  4557 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.522856  4556 ts_tablet_manager.cc:1403] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.011s
I20260709 12:12:59.524122  4557 ts_tablet_manager.cc:1434] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:59.524032  4555 raft_consensus.cc:359] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.524819  4555 raft_consensus.cc:385] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.525061  4557 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.525091  4555 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.526100  4555 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.528374  4555 ts_tablet_manager.cc:1434] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:12:59.529390  4555 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.532788  4440 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.540279  4557 tablet_bootstrap.cc:654] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.540124  4363 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.544478  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:59.545698  4684 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.546204  4555 tablet_bootstrap.cc:654] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.546245  4684 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.547331  4684 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.550005  4366 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:12:59.551950  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.552767  4569 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.553514  4569 raft_consensus.cc:697] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:12:59.554294  4569 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.557061  4556 raft_consensus.cc:359] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.557544  4556 raft_consensus.cc:385] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.557775  4556 raft_consensus.cc:740] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.560433  4556 consensus_queue.cc:260] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.569799  4555 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.570295  4555 ts_tablet_manager.cc:1403] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.009s
I20260709 12:12:59.573232  4555 raft_consensus.cc:359] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.573905  4555 raft_consensus.cc:385] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.574172  4555 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.574741  4556 ts_tablet_manager.cc:1434] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.005s
I20260709 12:12:59.574888  4555 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.575935  4556 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.576797  4555 ts_tablet_manager.cc:1434] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:12:59.577735  4555 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.578048  4264 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.581817  4557 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.582756  4556 tablet_bootstrap.cc:654] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.589174  4557 ts_tablet_manager.cc:1403] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 12:12:59.585119  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.591184  4607 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:59.592039  4557 raft_consensus.cc:359] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.593080  4557 raft_consensus.cc:385] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.593421  4557 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.594292  4557 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.597306  4607 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.597556  4557 ts_tablet_manager.cc:1434] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:59.597793  4607 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.598780  4557 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.600715  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.601387  4440 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:12:59.602644  4332 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:59.603463  4711 raft_consensus.cc:2804] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.603797  4711 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.604140  4711 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.608762  4557 tablet_bootstrap.cc:654] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.615916  4556 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.616441  4556 ts_tablet_manager.cc:1403] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.016s
I20260709 12:12:59.619414  4607 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.586498  4555 tablet_bootstrap.cc:654] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.619313  4556 raft_consensus.cc:359] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.620085  4556 raft_consensus.cc:385] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.620375  4556 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.621268  4556 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.621847  4611 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.622340  4611 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.622574  4711 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.624337  4611 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.625355  4711 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.626235  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.626490  4557 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.626956  4441 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.627144  4557 ts_tablet_manager.cc:1403] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260709 12:12:59.624331  4556 ts_tablet_manager.cc:1434] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:59.628813  4556 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.630443  4557 raft_consensus.cc:359] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.630903  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:59.631280  4557 raft_consensus.cc:385] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.631676  4557 raft_consensus.cc:740] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.632715  4684 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.632486  4557 consensus_queue.cc:260] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.633169  4684 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.633667  4684 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.635262  4557 ts_tablet_manager.cc:1434] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:59.636242  4557 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.636502  4556 tablet_bootstrap.cc:654] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.636983  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.638080  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.638751  4515 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
W20260709 12:12:59.639055  4481 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.639808  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:59.640628  4514 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.643268  4576 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.639732  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.646836  4441 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.651682  4711 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.656175  4569 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.656926  4569 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.661007  4576 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.661628  4576 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.666106  4576 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:12:59.639743  4481 leader_election.cc:343] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.672170  4595 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.672824  4595 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.676474  4595 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.687827  4569 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.690745  4555 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.691318  4555 ts_tablet_manager.cc:1403] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.036s
I20260709 12:12:59.691569  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.695369  4557 tablet_bootstrap.cc:654] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.693848  4555 raft_consensus.cc:359] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.697165  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.698439  4555 raft_consensus.cc:385] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.699919  4555 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.700783  4555 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.701558  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.702325  4513 raft_consensus.cc:2393] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:12:59.703474  4555 ts_tablet_manager.cc:1434] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:12:59.704481  4555 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.704437  4684 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.711323  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.711985  4515 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:12:59.713083  4441 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
W20260709 12:12:59.716460  4481 leader_election.cc:343] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.720831  4556 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.721268  4556 ts_tablet_manager.cc:1403] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.093s	user 0.039s	sys 0.026s
I20260709 12:12:59.761881  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.762635  4438 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.765307  4555 tablet_bootstrap.cc:654] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:59.766294  4481 consensus_peers.cc:597] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.767427  4514 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:12:59.770113  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.765676  4684 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.770916  4611 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.768927  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:12:59.769752  4406 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:12:59.774780  4569 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:59.774971  4481 leader_election.cc:343] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:59.777966  4407 leader_election.cc:343] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.779350  4332 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:12:59.782017  4711 raft_consensus.cc:2804] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.782565  4711 raft_consensus.cc:697] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:12:59.783484  4711 consensus_queue.cc:237] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.784296  4556 raft_consensus.cc:359] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.785068  4556 raft_consensus.cc:385] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.785386  4556 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.786047  4556 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.795248  4556 ts_tablet_manager.cc:1434] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.074s	user 0.012s	sys 0.010s
I20260709 12:12:59.796772  4556 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.818011  4569 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:59.818872  4611 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.821271  4611 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.823418  4556 tablet_bootstrap.cc:654] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:59.823603  4611 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.806428  4406 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.828547  4557 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:12:59.828684  4562 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.829124  4557 ts_tablet_manager.cc:1403] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.017s
I20260709 12:12:59.829115  4562 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.829632  4562 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.831132  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:12:59.831322  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 51514.4us
I20260709 12:12:59.831794  4439 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:12:59.835631  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.836310  4438 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.837656  4555 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:12:59.838163  4555 ts_tablet_manager.cc:1403] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.019s
I20260709 12:12:59.839344  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.844026  4576 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.844439  4576 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.844586  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:12:59.845793  4684 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:59.845645  4647 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.846266  4684 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.846762  4684 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.844794  4576 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.848637  4261 catalog_manager.cc:5697] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.850169  4711 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.850651  4711 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.855960  4555 raft_consensus.cc:359] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.856727  4555 raft_consensus.cc:385] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.857002  4555 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.857686  4555 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.861208  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.863230  4589 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:59.867730  4711 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.868347  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.871862  4562 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.877267  4438 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:12:59.881768  4562 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.883114  4555 ts_tablet_manager.cc:1434] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:12:59.880591  4557 raft_consensus.cc:359] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.884752  4557 raft_consensus.cc:385] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.884992  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:12:59.885183  4557 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.887533  4555 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:12:59.869473  4684 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:12:59.892465  4481 leader_election.cc:343] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:59.888418  4557 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.892493  4611 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:59.909724  4689 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.910068  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:12:59.910326  4689 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.910782  4513 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.910918  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.889070  4647 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:12:59.914549  4611 raft_consensus.cc:697] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:12:59.915763  4611 consensus_queue.cc:237] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.884332  4576 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.920075  4689 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.912119  4637 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.918292  4557 ts_tablet_manager.cc:1434] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:12:59.923965  4556 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:12:59.924764  4556 ts_tablet_manager.cc:1403] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.128s	user 0.021s	sys 0.026s
I20260709 12:12:59.925886  4557 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:12:59.928869  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:12:59.929505  4439 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:59.931115  4556 raft_consensus.cc:359] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.925107  4637 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.932163  4556 raft_consensus.cc:385] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:59.932529  4556 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:12:59.933228  4556 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.934319  4646 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.933770  4637 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:12:59.936117  4556 ts_tablet_manager.cc:1434] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 12:12:59.987973  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 50023.4us
I20260709 12:12:59.994871  4556 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:12:59.920075  4684 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.944830  4647 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.954138  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:12:59.934811  4646 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:12:59.954453  4595 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.950789  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:12:59.951270  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:12:59.954049  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.022612  4595 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.025549  4646 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:12:59.995715  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.017938  4441 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:00.017725  4647 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.029032  4647 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:00.028980  4595 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.001963  4439 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:00.010154  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.035109  4555 tablet_bootstrap.cc:654] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.007185  4513 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:00.033861  4364 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
W20260709 12:13:00.046017  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 46130.7us
I20260709 12:13:00.036705  4711 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.050074  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:00.051103  4711 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.051474  4711 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.051805  4711 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.052659  4689 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.058365  4637 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.059126  4637 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:00.085137  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 103062us
I20260709 12:13:00.041253  4515 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:00.099649  4562 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.100370  4562 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.102833  4562 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.116397  4407 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:00.120823  4595 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.121313  4595 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.121723  4595 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.123184  4556 tablet_bootstrap.cc:654] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.130507  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.132742  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.134675  4576 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:00.139314  4595 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:00.140774  4407 leader_election.cc:343] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.143553  4481 leader_election.cc:343] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.149283  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:00.150020  4441 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.150594  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:00.154431  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:00.167302  4512 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.172948  4437 raft_consensus.cc:2393] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:00.196898  4557 tablet_bootstrap.cc:654] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.197196  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.155288  4637 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.199136  4555 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:00.199666  4555 ts_tablet_manager.cc:1403] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.314s	user 0.041s	sys 0.037s
I20260709 12:13:00.160060  4711 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.161253  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.162547  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.203651  4555 raft_consensus.cc:359] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.204339  4555 raft_consensus.cc:385] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.162914  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.204625  4555 raft_consensus.cc:740] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.205036  4513 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:00.205323  4576 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.205824  4576 raft_consensus.cc:697] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:00.206068  4441 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:00.206661  4576 consensus_queue.cc:237] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.207267  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.207824  4646 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.166218  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.208817  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.205298  4555 consensus_queue.cc:260] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.214524  4514 raft_consensus.cc:2468] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:00.218629  4555 ts_tablet_manager.cc:1434] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:13:00.219638  4555 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:00.219485  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.221714  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.222201  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.223382  4365 raft_consensus.cc:2393] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:00.222951  4607 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.231340  4515 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:00.230691  4406 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.234148  4637 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.244637  4363 raft_consensus.cc:2393] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:00.247076  4595 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:00.253567  4406 leader_election.cc:343] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.254328  4406 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:00.261767  4562 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.262163  4562 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.262471  4562 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.263440  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:00.264612  4437 raft_consensus.cc:2393] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:00.269325  4562 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.271844  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.284632  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.255304  4637 raft_consensus.cc:697] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:00.285696  4361 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.281226  4261 catalog_manager.cc:5697] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.294669  4562 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.295469  4406 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:00.297291  4562 raft_consensus.cc:2804] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.297645  4562 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.297951  4562 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.298133  4481 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.300765  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:00.292696  4365 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.308118  4747 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.310359  4746 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.310938  4746 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:00.311614  4746 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.295213  4711 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.286314  4637 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.304001  4595 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:13:00.333968  4557 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.335870  4557 ts_tablet_manager.cc:1403] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.410s	user 0.037s	sys 0.025s
I20260709 12:13:00.323176  4740 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.336699  4562 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.340494  4562 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:00.329493  4407 leader_election.cc:343] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.338956  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:00.339854  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 52043.8us
I20260709 12:13:00.357421  4556 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.361372  4556 ts_tablet_manager.cc:1403] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.367s	user 0.024s	sys 0.009s
I20260709 12:13:00.360810  4555 tablet_bootstrap.cc:654] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.369571  4557 raft_consensus.cc:359] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.370246  4557 raft_consensus.cc:385] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.370496  4557 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.375641  4557 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.384795  4557 ts_tablet_manager.cc:1434] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:13:00.386202  4557 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.380913  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:00.393163  4514 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.391791  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:00.393895  4513 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.406240  4556 raft_consensus.cc:359] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.407089  4556 raft_consensus.cc:385] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.407375  4556 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.408073  4556 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.409744  4556 ts_tablet_manager.cc:1434] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 12:13:00.410792  4556 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
W20260709 12:13:00.395957  4407 leader_election.cc:343] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.399354  4595 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.444460  4747 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.444226  4595 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.446568  4595 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:00.451586  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59467.8us
I20260709 12:13:00.442850  4513 raft_consensus.cc:2468] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
W20260709 12:13:00.452455  4407 leader_election.cc:343] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.455217  4406 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:00.459477  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.459760  4407 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.462229  4365 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:00.466838  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.469187  4761 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.471807  4515 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
W20260709 12:13:00.474260  4406 leader_election.cc:343] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.475317  4562 raft_consensus.cc:2804] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.476389  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.479656  4406 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.480553  4562 raft_consensus.cc:697] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:00.480795  4555 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:00.481374  4555 ts_tablet_manager.cc:1403] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.262s	user 0.024s	sys 0.037s
I20260709 12:13:00.481356  4562 consensus_queue.cc:237] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.472788  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.485285  4607 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:00.495275  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:00.496253  4515 raft_consensus.cc:2393] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:00.501545  4762 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.485110  4747 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:00.503428  4331 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.505430  4762 raft_consensus.cc:697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:00.508297  4589 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.522400  4556 tablet_bootstrap.cc:654] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.523136  4769 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.523662  4769 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.528282  4769 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.508447  4740 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:13:00.537035  4762 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:00.541745  4407 leader_election.cc:343] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:00.547118  4407 leader_election.cc:343] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.546293  4562 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.550319  4557 tablet_bootstrap.cc:654] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.544866  4555 raft_consensus.cc:359] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.551643  4555 raft_consensus.cc:385] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.551930  4555 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
W20260709 12:13:00.553241  4407 leader_election.cc:343] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.553743  4407 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.554840  4555 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.560248  4555 ts_tablet_manager.cc:1434] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:13:00.561086  4555 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
W20260709 12:13:00.562548  4481 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:00.561792  4758 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.563423  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.575626  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.568120  4514 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:00.615578  4555 tablet_bootstrap.cc:654] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.620220  4406 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.621382  4758 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:00.621943  4758 raft_consensus.cc:697] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:00.622916  4758 consensus_queue.cc:237] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.625562  4556 tablet_bootstrap.cc:492] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.626025  4556 ts_tablet_manager.cc:1403] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.215s	user 0.024s	sys 0.003s
I20260709 12:13:00.626020  4331 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.627184  4607 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.628545  4557 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.629004  4557 ts_tablet_manager.cc:1403] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.243s	user 0.014s	sys 0.008s
I20260709 12:13:00.628686  4556 raft_consensus.cc:359] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.629366  4556 raft_consensus.cc:385] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.629658  4556 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.630306  4556 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.632578  4556 ts_tablet_manager.cc:1434] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:00.633006  4557 raft_consensus.cc:359] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.633659  4557 raft_consensus.cc:385] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.633950  4557 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.633471  4556 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.634559  4557 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.636654  4557 ts_tablet_manager.cc:1434] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:00.641746  4556 tablet_bootstrap.cc:654] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.648202  4557 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.654484  4556 tablet_bootstrap.cc:492] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.655028  4556 ts_tablet_manager.cc:1403] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:13:00.655117  4557 tablet_bootstrap.cc:654] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.653538  4261 catalog_manager.cc:5697] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.657529  4556 raft_consensus.cc:359] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.659847  4556 raft_consensus.cc:385] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.660144  4556 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.660996  4556 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.665246  4556 ts_tablet_manager.cc:1434] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:13:00.666215  4556 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.666538  4261 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:00.672057  4556 tablet_bootstrap.cc:654] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.675856  4555 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:00.676460  4555 ts_tablet_manager.cc:1403] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.007s
I20260709 12:13:00.677707  4557 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.678242  4557 ts_tablet_manager.cc:1403] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.005s
I20260709 12:13:00.680119  4555 raft_consensus.cc:359] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.681046  4555 raft_consensus.cc:385] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.681699  4555 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.681483  4557 raft_consensus.cc:359] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.682474  4557 raft_consensus.cc:385] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.682457  4555 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.683009  4557 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.684082  4556 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.684531  4556 ts_tablet_manager.cc:1403] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:13:00.684739  4555 ts_tablet_manager.cc:1434] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:00.685667  4555 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:00.683943  4557 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.687016  4556 raft_consensus.cc:359] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.687652  4556 raft_consensus.cc:385] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.687778  4557 ts_tablet_manager.cc:1434] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:00.687932  4556 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.689049  4557 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.688742  4556 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.691323  4555 tablet_bootstrap.cc:654] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.691531  4556 ts_tablet_manager.cc:1434] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:00.692459  4556 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.696242  4557 tablet_bootstrap.cc:654] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.699100  4263 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.700714  4556 tablet_bootstrap.cc:654] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.701654  4263 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.704599  4263 catalog_manager.cc:5697] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.706041  4557 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.706535  4557 ts_tablet_manager.cc:1403] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:13:00.710325  4557 raft_consensus.cc:359] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.711040  4557 raft_consensus.cc:385] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.711306  4557 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.712502  4557 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.717221  4555 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:00.717712  4555 ts_tablet_manager.cc:1403] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.008s
I20260709 12:13:00.717896  4360 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.718809  4557 ts_tablet_manager.cc:1434] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:13:00.726293  4746 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.726953  4557 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.732985  4557 tablet_bootstrap.cc:654] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.721454  4555 raft_consensus.cc:359] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.724686  4556 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.740610  4556 ts_tablet_manager.cc:1403] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 12:13:00.741096  4262 catalog_manager.cc:5697] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:00.743242  4556 raft_consensus.cc:359] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.743916  4556 raft_consensus.cc:385] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.744179  4556 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.744825  4556 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.746932  4556 ts_tablet_manager.cc:1434] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:13:00.747983  4556 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.749260  4362 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.753686  4555 raft_consensus.cc:385] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.754091  4555 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.755600  4758 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.756345  4758 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.758152  4747 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.771646  4555 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.773895  4555 ts_tablet_manager.cc:1434] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.006s
I20260709 12:13:00.774821  4555 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:00.775075  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.777526  4557 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.778050  4557 ts_tablet_manager.cc:1403] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.007s
W20260709 12:13:00.779393  4407 leader_election.cc:343] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.776114  4556 tablet_bootstrap.cc:654] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.781057  4557 raft_consensus.cc:359] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.781803  4557 raft_consensus.cc:385] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.782131  4557 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.783012  4557 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.788167  4758 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.788971  4747 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.792092  4555 tablet_bootstrap.cc:654] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.792769  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:00.796875  4406 leader_election.cc:343] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.797554  4406 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.798194  4771 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.802259  4556 tablet_bootstrap.cc:492] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.802788  4556 ts_tablet_manager.cc:1403] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.005s
I20260709 12:13:00.805450  4556 raft_consensus.cc:359] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.806126  4556 raft_consensus.cc:385] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.808717  4556 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.809485  4556 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.811878  4556 ts_tablet_manager.cc:1434] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:13:00.812772  4556 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.812809  4557 ts_tablet_manager.cc:1434] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:13:00.816241  4557 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.825794  4556 tablet_bootstrap.cc:654] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.818586  4746 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.826329  4746 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.829468  4555 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:00.829937  4555 ts_tablet_manager.cc:1403] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.002s
I20260709 12:13:00.835203  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.830278  4746 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:00.837757  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.838114  4555 raft_consensus.cc:359] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.838581  4437 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:00.838861  4555 raft_consensus.cc:385] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.839203  4555 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.840077  4557 tablet_bootstrap.cc:654] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.840077  4555 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.833616  4611 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:00.844571  4555 ts_tablet_manager.cc:1434] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:00.845131  4364 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.845502  4555 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:00.850306  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:00.854382  4481 leader_election.cc:343] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.858222  4746 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:00.863097  4746 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.863477  4746 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.865415  4771 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.865929  4607 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.870640  4607 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.878937  4556 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:00.879745  4556 ts_tablet_manager.cc:1403] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.008s
I20260709 12:13:00.881229  4555 tablet_bootstrap.cc:654] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:00.890426  4557 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:00.891062  4557 ts_tablet_manager.cc:1403] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.014s
I20260709 12:13:00.891345  4746 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.891364  4556 raft_consensus.cc:359] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.892949  4556 raft_consensus.cc:385] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.893296  4556 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.894686  4556 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.906862  4746 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:00.913452  4769 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.916792  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:00.917835  4740 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.917991  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.932610  4771 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.932654  4562 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.933207  4771 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.933805  4562 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:00.936332  4481 leader_election.cc:343] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.942814  4562 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.944355  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.945138  4509 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:00.946924  4771 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.947743  4589 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.948282  4589 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.949306  4331 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:00.950629  4589 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.957455  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:00.956724  4557 raft_consensus.cc:359] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.959040  4557 raft_consensus.cc:385] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:00.959444  4557 raft_consensus.cc:740] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:00.951537  4607 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:00.952718  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.954692  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:00.955675  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.969449  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:00.969707  4407 leader_election.cc:343] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:00.970207  4366 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.976521  4513 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:00.970781  4439 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:00.978354  4331 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:00.962592  4556 ts_tablet_manager.cc:1434] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:13:00.980158  4556 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:00.960251  4557 consensus_queue.cc:260] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.983053  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:00.983320  4762 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:00.983861  4569 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:00.984126  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:00.984586  4589 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:00.986392  4406 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:00.915542  4769 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:00.997627  4557 ts_tablet_manager.cc:1434] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.003s
I20260709 12:13:00.962703  4740 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:00.999663  4407 leader_election.cc:343] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.008821  4557 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:00.998384  4439 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:01.009346  4762 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:01.039368  4406 leader_election.cc:343] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.039974  4406 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.041611  4562 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:01.030701  4576 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.046255  4569 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.049305  4576 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.065408  4769 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.064702  4555 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:01.067662  4555 ts_tablet_manager.cc:1403] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.222s	user 0.021s	sys 0.050s
I20260709 12:13:01.037676  4762 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.044618  4711 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:01.079056  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.065539  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.065176  4740 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.071835  4762 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.072492  4769 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.090392  4576 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.091892  4557 tablet_bootstrap.cc:654] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.091544  4769 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.096738  4360 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.096936  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.098865  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.096168  4555 raft_consensus.cc:359] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.099582  4439 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:01.099852  4555 raft_consensus.cc:385] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.100529  4555 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.100421  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:01.101574  4481 leader_election.cc:343] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.101706  4555 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:01.104090  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 64507.4us
I20260709 12:13:01.105312  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.106078  4555 ts_tablet_manager.cc:1434] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 12:13:01.111572  4555 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:01.113263  4569 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:01.121892  4407 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.107137  4576 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.122723  4509 raft_consensus.cc:2393] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:01.138167  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.138831  4512 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:01.139560  4557 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:01.140028  4481 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:01.131850  4576 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:01.140650  4331 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:01.141072  4740 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.141469  4740 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.141796  4740 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.141894  4331 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.144255  4589 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.144646  4589 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.145018  4589 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.145139  4759 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.124244  4769 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.140017  4557 ts_tablet_manager.cc:1403] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.008s
I20260709 12:13:01.141481  4576 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.145910  4762 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.168901  4747 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.183266  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.185274  4441 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.175027  4747 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.195777  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.199267  4741 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.199914  4711 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:01.200907  4711 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.199657  4741 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.201689  4741 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.203832  4747 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:01.193568  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 83080.7us
I20260709 12:13:01.207628  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.207705  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.210759  4364 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.209515  4589 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.224386  4557 raft_consensus.cc:359] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.225126  4557 raft_consensus.cc:385] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.225459  4557 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.226334  4557 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.223214  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:01.232237  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.232950  4438 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.235339  4556 tablet_bootstrap.cc:654] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.236229  4481 leader_election.cc:343] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.241637  4740 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.243191  4762 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.243582  4562 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.244055  4562 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.245083  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:01.245851  4562 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.247126  4366 raft_consensus.cc:2393] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:01.256013  4481 leader_election.cc:343] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.256403  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.257930  4557 ts_tablet_manager.cc:1434] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.001s
W20260709 12:13:01.255738  4407 leader_election.cc:343] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.259979  4746 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.282445  4741 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.286541  4802 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.271423  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.254169  4711 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.289419  4261 catalog_manager.cc:5697] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.277825  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:01.285996  4740 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.308180  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.308324  4589 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.308836  4439 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.315117  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.287096  4802 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.317093  4439 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:01.317397  4711 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.320683  4557 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:01.321915  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.331928  4440 raft_consensus.cc:2393] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:01.333629  4741 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.335961  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:01.337387  4802 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.339432  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:01.340464  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:01.318787  4511 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.344456  4481 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:01.347880  4406 leader_election.cc:343] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.351099  4555 tablet_bootstrap.cc:654] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.357450  4407 leader_election.cc:343] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.358644  4407 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.359386  4562 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.360306  4332 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:01.345536  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.353461  4514 raft_consensus.cc:2393] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:01.364795  4569 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.364715  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.365243  4576 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.365447  4569 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.348053  4801 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 12:13:01.362329  4481 leader_election.cc:343] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.374095  4607 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.374667  4607 raft_consensus.cc:697] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:01.374794  4437 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.375559  4556 tablet_bootstrap.cc:492] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:01.376010  4556 ts_tablet_manager.cc:1403] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.396s	user 0.011s	sys 0.011s
I20260709 12:13:01.376592  4607 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.378458  4569 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.379035  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.385504  4511 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:01.388840  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.390128  4556 raft_consensus.cc:359] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.391220  4556 raft_consensus.cc:385] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.391628  4556 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.392813  4809 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:01.394395  4556 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:01.399391  4407 leader_election.cc:343] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.400090  4556 ts_tablet_manager.cc:1434] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:13:01.402966  4759 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.405190  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:01.410347  4407 leader_election.cc:343] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.419701  4557 tablet_bootstrap.cc:654] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.423772  4555 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:01.424301  4555 ts_tablet_manager.cc:1403] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.313s	user 0.029s	sys 0.004s
I20260709 12:13:01.425906  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.427963  4556 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:01.428820  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.431172  4510 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:01.431604  4437 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:01.431924  4569 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.432772  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.433486  4746 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.434021  4746 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:01.436488  4406 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.437219  4746 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.450306  4555 raft_consensus.cc:359] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.450902  4555 raft_consensus.cc:385] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.451217  4555 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.451916  4555 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:01.452251  4406 leader_election.cc:343] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.452803  4406 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.454452  4771 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.456344  4562 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.456483  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.458155  4555 ts_tablet_manager.cc:1434] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.003s
I20260709 12:13:01.458117  4562 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.458806  4562 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.459300  4562 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.457747  4771 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:01.464114  4771 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.468504  4555 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:01.485097  4562 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.489029  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:01.491725  4407 leader_election.cc:343] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.493993  4556 tablet_bootstrap.cc:654] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.502140  4562 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.495862  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:01.512041  4511 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.518265  4555 tablet_bootstrap.cc:654] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.523799  4557 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:01.524248  4557 ts_tablet_manager.cc:1403] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.030s
I20260709 12:13:01.529652  4557 raft_consensus.cc:359] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.530633  4557 raft_consensus.cc:385] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:01.532058  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:01.534039  4557 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.536024  4511 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:01.538064  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.539184  4562 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.538522  4557 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.539811  4562 raft_consensus.cc:697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:01.540725  4562 consensus_queue.cc:237] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.542141  4557 ts_tablet_manager.cc:1434] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:13:01.543699  4557 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:01.548717  4555 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:01.549469  4555 ts_tablet_manager.cc:1403] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.020s
I20260709 12:13:01.551556  4557 tablet_bootstrap.cc:654] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.554356  4556 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:01.555420  4556 ts_tablet_manager.cc:1403] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.003s
I20260709 12:13:01.552430  4555 raft_consensus.cc:359] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.558593  4555 raft_consensus.cc:385] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.558893  4555 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.558243  4556 raft_consensus.cc:359] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.560241  4556 raft_consensus.cc:385] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.560547  4556 raft_consensus.cc:740] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.561371  4555 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.562498  4556 consensus_queue.cc:260] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.565243  4556 ts_tablet_manager.cc:1434] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:13:01.566221  4556 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:01.571611  4364 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.572599  4556 tablet_bootstrap.cc:654] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.575608  4555 ts_tablet_manager.cc:1434] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:13:01.576606  4555 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:01.698659  4555 tablet_bootstrap.cc:700] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Time spent opening tablet: real 0.112s	user 0.019s	sys 0.005s
I20260709 12:13:01.699378  4555 tablet_bootstrap.cc:654] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.703685  4361 raft_consensus.cc:1240] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:01.707427  4607 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.708066  4607 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.708797  4556 tablet_bootstrap.cc:492] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:01.709311  4556 ts_tablet_manager.cc:1403] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.016s
I20260709 12:13:01.712241  4556 raft_consensus.cc:359] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.712956  4556 raft_consensus.cc:385] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.713248  4556 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.713924  4556 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.715145  4360 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.720014  4637 consensus_queue.cc:1059] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:01.721665  4741 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.722208  4741 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.724109  4746 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.724463  4741 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.728684  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.728981  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.729792  4437 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:01.728070  4607 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.731591  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:01.734089  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.734807  4437 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.739763  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.737188  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:01.750355  4481 leader_election.cc:343] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.760403  4801 raft_consensus.cc:3055] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:01.761005  4801 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:01.762117  4801 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:01.763916  4771 consensus_queue.cc:1175] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a359ff757b3a4babb1229aa08bc44a60" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:13:01.745693  4747 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.763917  4801 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.770761  4747 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.775240  4747 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.782828  4747 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.784791  4263 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.786141  4747 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.790017  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.790719  4437 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.799139  4555 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:01.799676  4555 ts_tablet_manager.cc:1403] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.223s	user 0.031s	sys 0.005s
I20260709 12:13:01.815129  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:01.820874  4556 ts_tablet_manager.cc:1434] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.002s
I20260709 12:13:01.821343  4607 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:01.822232  4747 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:01.822481  4481 leader_election.cc:343] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.823994  4556 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:01.825733  4557 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:01.823203  4607 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:01.826493  4607 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.826164  4557 ts_tablet_manager.cc:1403] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.283s	user 0.036s	sys 0.061s
I20260709 12:13:01.829550  4557 raft_consensus.cc:359] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.830085  4556 tablet_bootstrap.cc:654] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.830228  4557 raft_consensus.cc:385] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.830492  4557 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.831192  4557 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.834003  4607 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.802630  4555 raft_consensus.cc:359] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.840509  4555 raft_consensus.cc:385] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.841006  4555 raft_consensus.cc:740] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.841846  4555 consensus_queue.cc:260] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.843958  4607 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.844472  4557 ts_tablet_manager.cc:1434] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:13:01.845979  4557 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:01.847101  4264 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.851295  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:01.854729  4557 tablet_bootstrap.cc:654] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.860239  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:01.862897  4365 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:01.855299  4759 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.867622  4556 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:01.868297  4556 ts_tablet_manager.cc:1403] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.010s
I20260709 12:13:01.871126  4331 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.871970  4759 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:01.873168  4607 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.858417  4555 ts_tablet_manager.cc:1434] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:13:01.876561  4555 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:01.874884  4556 raft_consensus.cc:359] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.882109  4556 raft_consensus.cc:385] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.882550  4556 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.883428  4556 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.888581  4556 ts_tablet_manager.cc:1434] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:13:01.889995  4556 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:01.899927  4437 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:01.901098  4611 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.906244  4557 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:01.906699  4557 ts_tablet_manager.cc:1403] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.061s	user 0.034s	sys 0.011s
I20260709 12:13:01.906639  4611 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:01.907254  4611 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:01.908296  4611 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.909590  4557 raft_consensus.cc:359] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.910301  4557 raft_consensus.cc:385] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.910576  4557 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.910701  4611 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.911393  4557 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.913173  4555 tablet_bootstrap.cc:654] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.915503  4557 ts_tablet_manager.cc:1434] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:13:01.916447  4557 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
W20260709 12:13:01.902122  4481 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.905597  4556 tablet_bootstrap.cc:654] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.904983  4262 catalog_manager.cc:5697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.918107  4802 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.919308  4262 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.922897  4557 tablet_bootstrap.cc:654] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.928962  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:01.930748  4747 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.931281  4747 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:01.931576  4611 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.932144  4747 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.932740  4611 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.934959  4611 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:01.936216  4557 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:01.936757  4557 ts_tablet_manager.cc:1403] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:13:01.937448  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.938308  4361 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.939647  4557 raft_consensus.cc:359] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.940356  4557 raft_consensus.cc:385] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.940626  4557 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.941325  4557 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.943763  4557 ts_tablet_manager.cc:1434] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:01.946609  4555 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:01.947121  4555 ts_tablet_manager.cc:1403] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.000s
I20260709 12:13:01.947376  4562 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.947803  4562 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.949609  4562 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:01.950754  4802 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.951611  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:01.951745  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:01.952900  4406 leader_election.cc:343] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:01.953382  4407 leader_election.cc:343] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.953737  4407 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:01.954000  4557 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:01.954703  4802 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:01.955256  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.955941  4437 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:01.956481  4481 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:01.957218  4611 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:01.957659  4611 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.958077  4611 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.959237  4576 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:01.949693  4555 raft_consensus.cc:359] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.973088  4555 raft_consensus.cc:385] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.973383  4555 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.975970  4556 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:01.976467  4556 ts_tablet_manager.cc:1403] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.000s
I20260709 12:13:01.978072  4555 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.979190  4743 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.979632  4743 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.979712  4556 raft_consensus.cc:359] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.980443  4556 raft_consensus.cc:385] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.980703  4556 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.981480  4556 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:01.983449  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:01.986332  4557 tablet_bootstrap.cc:654] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:01.987433  4407 consensus_peers.cc:597] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.981791  4743 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:01.990425  4481 leader_election.cc:343] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:01.990442  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:01.991528  4441 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:02.001808  4557 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.003865  4611 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.003887  4556 ts_tablet_manager.cc:1434] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:02.013139  4556 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.006425  4557 ts_tablet_manager.cc:1403] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.002s
I20260709 12:13:02.007184  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:02.015547  4747 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.015964  4747 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.016352  4747 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.019261  4556 tablet_bootstrap.cc:654] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.020644  4611 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.024482  4361 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.980154  4555 ts_tablet_manager.cc:1434] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 12:13:02.026489  4555 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.033332  4743 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.033586  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:02.033885  4743 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.034482  4441 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.035936  4743 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.040552  4802 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.040998  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:02.041695  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.041738  4361 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.042356  4437 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:02.047374  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.048065  4360 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:02.049803  4557 raft_consensus.cc:359] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.050580  4557 raft_consensus.cc:385] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.061008  4361 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:02.063019  4556 tablet_bootstrap.cc:492] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.063560  4556 ts_tablet_manager.cc:1403] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.008s
I20260709 12:13:02.065500  4747 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.063936  4481 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.066756  4743 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.066351  4556 raft_consensus.cc:359] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.067140  4743 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.067204  4556 raft_consensus.cc:385] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.067617  4743 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.067622  4556 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.068534  4556 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.054267  4441 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:02.050861  4557 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.070513  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:02.071025  4556 ts_tablet_manager.cc:1434] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:02.071169  4747 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.071991  4556 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.074496  4555 tablet_bootstrap.cc:654] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.071054  4557 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.075021  4481 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:02.076733  4481 leader_election.cc:343] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.077644  4557 ts_tablet_manager.cc:1434] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:13:02.078044  4611 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.078380  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:02.078580  4611 raft_consensus.cc:697] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:02.078974  4438 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.078620  4557 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.082573  4611 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.080379  4743 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.066345  4264 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.087882  4556 tablet_bootstrap.cc:654] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.089509  4438 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:02.090927  4743 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.093956  4557 tablet_bootstrap.cc:654] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.094440  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:02.109474  4361 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.113129  4556 tablet_bootstrap.cc:492] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.113766  4556 ts_tablet_manager.cc:1403] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.008s
I20260709 12:13:02.097034  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:02.115304  4438 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.098652  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:02.119544  4743 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.120038  4743 raft_consensus.cc:697] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:02.120232  4438 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:02.120884  4743 consensus_queue.cc:237] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.104497  4555 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.121457  4481 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.123075  4740 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.123574  4740 raft_consensus.cc:697] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:02.122397  4555 ts_tablet_manager.cc:1403] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.008s
I20260709 12:13:02.124492  4740 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.124959  4556 raft_consensus.cc:359] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.125628  4556 raft_consensus.cc:385] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.125921  4556 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.127341  4556 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.128466  4361 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:02.128895  4556 ts_tablet_manager.cc:1434] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:13:02.129786  4555 raft_consensus.cc:359] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.130330  4555 raft_consensus.cc:385] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.130354  4556 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.130594  4555 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.131417  4555 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.133677  4555 ts_tablet_manager.cc:1434] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:13:02.134579  4555 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.149205  4557 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.149978  4557 ts_tablet_manager.cc:1403] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.003s
I20260709 12:13:02.164464  4556 tablet_bootstrap.cc:654] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.166623  4264 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.164511  4555 tablet_bootstrap.cc:654] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.167487  4557 raft_consensus.cc:359] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.171634  4557 raft_consensus.cc:385] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.171916  4557 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.174842  4557 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.176949  4557 ts_tablet_manager.cc:1434] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:13:02.177855  4557 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.182857  4556 tablet_bootstrap.cc:492] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.183341  4556 ts_tablet_manager.cc:1403] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.028s
I20260709 12:13:02.183614  4264 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.184767  4264 catalog_manager.cc:5697] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.185792  4556 raft_consensus.cc:359] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.186503  4556 raft_consensus.cc:385] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.186741  4556 raft_consensus.cc:740] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.187263  4557 tablet_bootstrap.cc:654] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.187431  4556 consensus_queue.cc:260] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.189560  4556 ts_tablet_manager.cc:1434] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:02.190421  4556 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.194042  4555 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.194492  4555 ts_tablet_manager.cc:1403] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 12:13:02.196355  4556 tablet_bootstrap.cc:654] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.197670  4555 raft_consensus.cc:359] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.198381  4555 raft_consensus.cc:385] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.198647  4555 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.199479  4555 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.202363  4555 ts_tablet_manager.cc:1434] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:13:02.203495  4555 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.203907  4556 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.204299  4557 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.204833  4557 ts_tablet_manager.cc:1403] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 12:13:02.207358  4557 raft_consensus.cc:359] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.208563  4556 ts_tablet_manager.cc:1403] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 12:13:02.209146  4555 tablet_bootstrap.cc:654] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.207965  4557 raft_consensus.cc:385] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.211736  4557 raft_consensus.cc:740] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.212417  4557 consensus_queue.cc:260] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.214419  4557 ts_tablet_manager.cc:1434] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:02.211215  4556 raft_consensus.cc:359] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.215674  4556 raft_consensus.cc:385] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.216353  4557 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.218616  4555 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.219112  4555 ts_tablet_manager.cc:1403] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:13:02.215947  4556 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.221532  4556 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.222167  4555 raft_consensus.cc:359] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.222800  4555 raft_consensus.cc:385] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.223064  4555 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.223943  4556 ts_tablet_manager.cc:1434] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:13:02.224596  4555 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.231179  4555 ts_tablet_manager.cc:1434] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:02.232128  4555 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.236358  4557 tablet_bootstrap.cc:654] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.237298  4556 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.237643  4555 tablet_bootstrap.cc:654] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.247128  4556 tablet_bootstrap.cc:654] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.249313  4759 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.249868  4759 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.252835  4759 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.253969  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.254837  4759 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.254752  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.255510  4759 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.257530  4332 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.258108  4759 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.259146  4807 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.259761  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.261126  4557 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.262980  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.263983  4556 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.264519  4556 ts_tablet_manager.cc:1403] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 12:13:02.265833  4557 ts_tablet_manager.cc:1403] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 12:13:02.268453  4332 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.268625  4557 raft_consensus.cc:359] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.269609  4557 raft_consensus.cc:385] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.269536  4807 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.270035  4557 raft_consensus.cc:740] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.270718  4557 consensus_queue.cc:260] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.272642  4556 raft_consensus.cc:359] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.273365  4556 raft_consensus.cc:385] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.273023  4557 ts_tablet_manager.cc:1434] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:02.273689  4556 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.274784  4556 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.276413  4557 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.277658  4556 ts_tablet_manager.cc:1434] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:13:02.278301  4555 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.278666  4556 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.279398  4555 ts_tablet_manager.cc:1403] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.018s
I20260709 12:13:02.281914  4555 raft_consensus.cc:359] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.282639  4555 raft_consensus.cc:385] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.282908  4555 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.283560  4555 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.285341  4556 tablet_bootstrap.cc:654] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.285606  4555 ts_tablet_manager.cc:1434] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:02.287240  4555 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.290645  4806 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.291157  4806 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.293289  4806 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.294432  4555 tablet_bootstrap.cc:654] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.300194  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.300866  4511 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.302232  4406 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.302975  4802 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.303356  4802 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.303663  4802 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.309907  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.310608  4361 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.332901  4759 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.333225  4802 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.333431  4759 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.335347  4759 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.336938  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:02.337240  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.337836  4511 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.338423  4557 tablet_bootstrap.cc:654] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.341537  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:02.342124  4361 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.347384  4555 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.347409  4556 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.348042  4556 ts_tablet_manager.cc:1403] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.026s
I20260709 12:13:02.347962  4511 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:02.348568  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.347988  4555 ts_tablet_manager.cc:1403] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.061s	user 0.034s	sys 0.024s
I20260709 12:13:02.349401  4437 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:02.349751  4406 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.350565  4365 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.351080  4556 raft_consensus.cc:359] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.351639  4555 raft_consensus.cc:359] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.352371  4555 raft_consensus.cc:385] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.352974  4555 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.351958  4556 raft_consensus.cc:385] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.353471  4556 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.353634  4555 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.354138  4556 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.356382  4806 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.356725  4555 ts_tablet_manager.cc:1434] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:13:02.357249  4361 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:02.357719  4555 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.335350  4802 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.359889  4557 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.360119  4556 ts_tablet_manager.cc:1434] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:02.360525  4557 ts_tablet_manager.cc:1403] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.003s
I20260709 12:13:02.361032  4556 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.363773  4557 raft_consensus.cc:359] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.364676  4557 raft_consensus.cc:385] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.365094  4555 tablet_bootstrap.cc:654] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.365015  4557 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.366001  4557 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.367080  4556 tablet_bootstrap.cc:654] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.369196  4557 ts_tablet_manager.cc:1434] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:02.370465  4557 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.378525  4556 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.356889  4806 raft_consensus.cc:697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:02.379063  4556 ts_tablet_manager.cc:1403] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:13:02.381744  4557 tablet_bootstrap.cc:654] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.382159  4556 raft_consensus.cc:359] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.382501  4771 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.382872  4556 raft_consensus.cc:385] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.383188  4556 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.383059  4771 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.383822  4556 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.385124  4771 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.385998  4556 ts_tablet_manager.cc:1434] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:02.387071  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.387750  4511 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.389009  4406 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.390074  4771 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.390573  4771 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.391088  4771 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.379987  4806 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.399662  4332 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.401614  4807 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.411057  4743 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.411784  4743 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.412444  4771 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.414501  4743 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.415019  4809 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.415527  4809 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.416539  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.417671  4809 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.418334  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:02.419101  4511 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.419488  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.423658  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.424526  4514 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:02.426440  4331 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.427410  4809 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.427946  4809 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.428380  4809 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.415848  4771 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.443652  4511 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:02.444916  4406 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:02.444748  4481 leader_election.cc:343] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:02.445931  4481 leader_election.cc:343] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.446213  4771 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.446491  4481 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:02.447168  4771 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:02.447638  4557 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.447525  4747 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.448212  4557 ts_tablet_manager.cc:1403] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.037s
I20260709 12:13:02.448212  4771 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.455077  4557 raft_consensus.cc:359] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.455742  4557 raft_consensus.cc:385] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.456020  4557 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.456645  4557 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.458849  4557 ts_tablet_manager.cc:1434] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:13:02.459796  4557 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.461997  4802 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.462448  4807 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.468103  4556 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.462710  4802 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.454526  4809 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.469542  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.470067  4747 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.478395  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.479223  4438 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:02.476200  4801 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.481304  4801 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.472249  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.471104  4802 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.470219  4360 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.498466  4366 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.496093  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.501578  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:02.504580  4361 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.507544  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:02.509172  4407 leader_election.cc:343] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:02.509298  4406 leader_election.cc:343] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.496605  4801 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.496440  4743 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:13:02.519524  4556 tablet_bootstrap.cc:654] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.534879  4360 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.540881  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:02.542295  4406 leader_election.cc:343] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:02.542526  4407 leader_election.cc:343] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.542793  4406 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.543020  4407 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.544436  4802 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.545897  4562 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.548038  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:02.548663  4438 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.566285  4809 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.570174  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:02.572798  4557 tablet_bootstrap.cc:654] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.574137  4261 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.585184  4801 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.593119  4759 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.593636  4759 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.595863  4438 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
W20260709 12:13:02.588398  4870 log.cc:927] Time spent T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 12:13:02.570843  4514 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.596048  4759 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.585692  4747 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.600056  4741 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.600384  4801 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.598650  4562 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.602716  4562 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.604887  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.605172  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.605683  4562 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:02.608088  4407 leader_election.cc:343] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.608932  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:02.611853  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.607227  4611 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.613631  4406 leader_election.cc:343] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.613775  4611 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.615264  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.616029  4611 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:02.616408  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.607386  4361 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
W20260709 12:13:02.616751  4407 leader_election.cc:343] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.617214  4407 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.618135  4872 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:02.619951  4331 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.620688  4562 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.643271  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:02.636371  4743 consensus_queue.cc:1048] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:13:02.647929  4555 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.648393  4555 ts_tablet_manager.cc:1403] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.291s	user 0.050s	sys 0.093s
W20260709 12:13:02.652233  4481 leader_election.cc:343] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.653373  4562 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.653967  4562 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.655237  4555 raft_consensus.cc:359] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.655956  4555 raft_consensus.cc:385] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.656224  4555 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.658838  4555 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.635362  4872 raft_consensus.cc:697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:02.638638  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.682513  4562 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.684602  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.685392  4555 ts_tablet_manager.cc:1434] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:13:02.684887  4872 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.685671  4514 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:02.686038  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.686741  4555 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.658211  4801 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:02.687974  4406 leader_election.cc:343] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.690387  4406 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.692545  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:02.700074  4406 leader_election.cc:343] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.704087  4557 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.704720  4557 ts_tablet_manager.cc:1403] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.245s	user 0.011s	sys 0.014s
I20260709 12:13:02.701975  4261 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:02.715605  4407 leader_election.cc:343] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.716150  4407 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.717013  4562 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.700701  4801 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:02.723366  4481 leader_election.cc:343] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.724506  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:02.725234  4576 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.725449  4747 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:02.731680  4556 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.732306  4556 ts_tablet_manager.cc:1403] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.264s	user 0.025s	sys 0.015s
I20260709 12:13:02.732571  4557 raft_consensus.cc:359] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.733342  4557 raft_consensus.cc:385] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.733438  4759 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:02.733640  4557 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.734380  4557 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.739959  4556 raft_consensus.cc:359] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.741019  4556 raft_consensus.cc:385] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.741418  4556 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.746032  4557 ts_tablet_manager.cc:1434] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:13:02.748813  4557 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.757915  4556 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.761612  4556 ts_tablet_manager.cc:1434] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:13:02.751463  4555 tablet_bootstrap.cc:654] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.762910  4556 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
W20260709 12:13:02.771138  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44427.8us
I20260709 12:13:02.773105  4556 tablet_bootstrap.cc:654] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.779230  4555 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.779758  4555 ts_tablet_manager.cc:1403] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.000s
I20260709 12:13:02.786762  4759 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.787309  4759 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.789413  4759 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.790851  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:02.792282  4332 leader_election.cc:343] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.792555  4555 raft_consensus.cc:359] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.793423  4555 raft_consensus.cc:385] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.793777  4555 raft_consensus.cc:740] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.794471  4611 consensus_queue.cc:1048] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.794559  4555 consensus_queue.cc:260] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.797073  4555 ts_tablet_manager.cc:1434] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:02.797318  4557 tablet_bootstrap.cc:654] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.798111  4555 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.801769  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:02.804942  4331 leader_election.cc:343] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.805568  4331 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.808113  4759 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.814066  4801 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.822921  4555 tablet_bootstrap.cc:654] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.833364  4637 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.833925  4881 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:02.837826  4557 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.838332  4557 ts_tablet_manager.cc:1403] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.001s
I20260709 12:13:02.840721  4557 raft_consensus.cc:359] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.841169  4557 raft_consensus.cc:385] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.841323  4557 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.841727  4557 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.845481  4557 ts_tablet_manager.cc:1434] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:02.846416  4557 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.852128  4557 tablet_bootstrap.cc:654] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.865602  4557 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.866164  4557 ts_tablet_manager.cc:1403] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 12:13:02.869899  4562 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.870641  4562 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.872473  4557 raft_consensus.cc:359] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.872970  4562 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.873214  4557 raft_consensus.cc:385] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.876588  4264 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.879143  4556 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.882018  4556 ts_tablet_manager.cc:1403] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.119s	user 0.017s	sys 0.009s
I20260709 12:13:02.880267  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:02.879805  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.873548  4557 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
W20260709 12:13:02.891757  4407 leader_election.cc:343] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.891912  4557 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.894234  4557 ts_tablet_manager.cc:1434] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.001s
I20260709 12:13:02.895318  4557 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:02.899930  4562 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.900470  4562 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.901494  4557 tablet_bootstrap.cc:654] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.903780  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:02.905524  4407 leader_election.cc:343] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.906800  4562 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.906813  4556 raft_consensus.cc:359] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.908074  4556 raft_consensus.cc:385] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.908389  4556 raft_consensus.cc:740] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.909109  4556 consensus_queue.cc:260] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:02.907786  4406 leader_election.cc:343] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.910213  4406 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:02.913367  4555 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.914033  4555 ts_tablet_manager.cc:1403] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.004s
I20260709 12:13:02.915642  4556 ts_tablet_manager.cc:1434] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:13:02.916725  4556 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.921917  4637 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:02.924942  4556 tablet_bootstrap.cc:654] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.929843  4555 raft_consensus.cc:359] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.930585  4555 raft_consensus.cc:385] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.930847  4555 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.931493  4555 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.933595  4555 ts_tablet_manager.cc:1434] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:13:02.934573  4555 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:02.936157  4637 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.944747  4556 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:02.945287  4556 ts_tablet_manager.cc:1403] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.007s
I20260709 12:13:02.945449  4555 tablet_bootstrap.cc:654] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.948256  4556 raft_consensus.cc:359] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.949033  4556 raft_consensus.cc:385] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.949347  4556 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.950014  4556 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.952302  4556 ts_tablet_manager.cc:1434] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:13:02.953886  4556 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:02.957110  4806 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.963164  4806 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.965510  4806 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:02.974942  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.975651  4511 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.980506  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:02.981047  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:02.985118  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:02.985811  4511 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:02.985884  4406 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:02.986858  4557 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:02.987352  4557 ts_tablet_manager.cc:1403] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.092s	user 0.028s	sys 0.033s
I20260709 12:13:02.988049  4637 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.988447  4637 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.988760  4637 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.990473  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:02.990890  4557 raft_consensus.cc:359] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.991377  4802 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:02.991611  4557 raft_consensus.cc:385] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.991814  4802 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.991952  4557 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.992230  4802 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:02.992646  4557 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:02.994702  4557 ts_tablet_manager.cc:1434] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:13:02.995306  4872 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.995757  4407 leader_election.cc:343] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:02.998240  4555 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:02.998744  4555 ts_tablet_manager.cc:1403] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.015s
I20260709 12:13:03.001746  4555 raft_consensus.cc:359] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.002861  4555 raft_consensus.cc:385] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.995841  4872 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.003290  4555 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.003527  4802 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.003973  4555 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.004999  4872 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.005811  4556 tablet_bootstrap.cc:654] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.006841  4555 ts_tablet_manager.cc:1434] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:03.006902  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.007469  4806 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.007613  4511 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:03.007967  4806 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.008709  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.010063  4331 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.010342  4806 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.011042  4802 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.010396  4637 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.012338  4555 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.012547  4872 raft_consensus.cc:2804] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.012948  4872 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.013139  4637 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.013326  4872 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.012365  4407 leader_election.cc:343] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.020509  4555 tablet_bootstrap.cc:654] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.022687  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.022933  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.023940  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.024562  4514 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.026233  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.027447  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.028270  4508 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.029960  4556 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
W20260709 12:13:03.030473  4407 leader_election.cc:343] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.030514  4556 ts_tablet_manager.cc:1403] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.006s
W20260709 12:13:03.031287  4407 leader_election.cc:343] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.031946  4555 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.032420  4555 ts_tablet_manager.cc:1403] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:13:03.034070  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.034682  4437 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:03.034202  4556 raft_consensus.cc:359] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.035583  4556 raft_consensus.cc:385] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.035954  4556 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.035205  4557 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:03.037643  4556 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.039067  4406 leader_election.cc:343] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.045185  4406 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.045976  4771 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.044739  4872 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.050849  4872 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.051342  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.051975  4511 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.045459  4555 raft_consensus.cc:359] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.054221  4555 raft_consensus.cc:385] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.054512  4555 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.055290  4555 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.057674  4555 ts_tablet_manager.cc:1434] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:13:03.053117  4556 ts_tablet_manager.cc:1434] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:13:03.060581  4508 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:03.061760  4406 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.063154  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.063555  4514 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:03.063740  4441 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.064605  4637 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.064700  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.044520  4557 tablet_bootstrap.cc:654] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.065456  4637 raft_consensus.cc:697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:03.066911  4556 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.066579  4637 consensus_queue.cc:237] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.071277  4801 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.071839  4801 raft_consensus.cc:697] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:03.072755  4801 consensus_queue.cc:237] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.074060  4511 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:03.074200  4441 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:03.058621  4555 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.071669  4562 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.076395  4331 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.079109  4759 raft_consensus.cc:2804] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.079665  4759 raft_consensus.cc:697] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:03.080542  4759 consensus_queue.cc:237] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.084015  4555 tablet_bootstrap.cc:654] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.112730  4557 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:03.113258  4557 ts_tablet_manager.cc:1403] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.002s
I20260709 12:13:03.114319  4556 tablet_bootstrap.cc:654] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.115172  4802 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.115694  4802 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.117859  4802 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.120605  4555 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.121068  4555 ts_tablet_manager.cc:1403] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.005s
I20260709 12:13:03.124614  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.124716  4557 raft_consensus.cc:359] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.125586  4557 raft_consensus.cc:385] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.125874  4557 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.126577  4557 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.129345  4557 ts_tablet_manager.cc:1434] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:13:03.133489  4555 raft_consensus.cc:359] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.134202  4555 raft_consensus.cc:385] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.134471  4555 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.136489  4557 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
W20260709 12:13:03.135291  4407 leader_election.cc:343] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.135670  4555 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.143110  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.143710  4515 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:03.147223  4555 ts_tablet_manager.cc:1434] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 12:13:03.148775  4555 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.153621  4261 catalog_manager.cc:5697] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.155556  4406 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.159083  4801 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.163260  4801 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.167214  4801 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.183604  4555 tablet_bootstrap.cc:654] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.184551  4261 catalog_manager.cc:5697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.187639  4261 catalog_manager.cc:5697] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.181711  4759 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.192163  4759 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.195040  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:03.196343  4332 leader_election.cc:343] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.194097  4801 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.211417  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.212404  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.213037  4515 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
W20260709 12:13:03.214494  4407 leader_election.cc:343] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.201176  4759 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.224702  4556 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.225263  4556 ts_tablet_manager.cc:1403] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.017s
I20260709 12:13:03.227082  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.227694  4515 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.228698  4556 raft_consensus.cc:359] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.229401  4556 raft_consensus.cc:385] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.229719  4556 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.230568  4556 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.231313  4801 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.232903  4556 ts_tablet_manager.cc:1434] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:03.224769  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:03.236893  4809 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.237272  4809 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.237598  4809 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.244948  4809 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.244977  4515 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:03.249432  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.250061  4511 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.250910  4406 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.251883  4557 tablet_bootstrap.cc:654] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.253428  4556 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.257709  4555 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.258201  4555 ts_tablet_manager.cc:1403] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.026s
I20260709 12:13:03.247102  4809 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.247643  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.261237  4555 raft_consensus.cc:359] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.263561  4332 leader_election.cc:343] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.263691  4555 raft_consensus.cc:385] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.252364  4801 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.264505  4801 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:03.264017  4555 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.266038  4555 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.266525  4881 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:03.272348  4881 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.265467  4801 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.275152  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.275942  4361 raft_consensus.cc:2393] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:03.277163  4556 tablet_bootstrap.cc:654] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.277379  4881 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.267716  4809 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.269281  4555 ts_tablet_manager.cc:1434] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:13:03.270717  4511 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:03.279706  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.280331  4441 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:03.280414  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:03.281284  4481 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.282295  4611 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:03.282609  4611 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:03.283133  4759 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.283577  4759 raft_consensus.cc:697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:03.284377  4759 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.278641  4555 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.282948  4611 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.299539  4809 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.300073  4809 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.303073  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.303768  4441 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:03.304839  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:03.305531  4872 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.305891  4872 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.306252  4872 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.307109  4809 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.311298  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.312250  4511 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
I20260709 12:13:03.302896  4611 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.317334  4611 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.317860  4809 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:03.318624  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.318840  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.319554  4361 raft_consensus.cc:2393] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:03.323362  4872 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.324069  4741 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.326751  4741 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.329855  4741 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.330367  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.331091  4361 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:03.332175  4441 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:03.335258  4481 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.336248  4743 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.336875  4743 raft_consensus.cc:697] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:03.337059  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.338073  4743 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.341653  4481 leader_election.cc:343] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.342612  4481 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:03.343973  4562 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:03.344399  4576 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.344936  4576 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.344471  4562 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.345296  4576 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.334807  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.346719  4562 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.346882  4441 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.349050  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.352353  4514 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:03.350104  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.353896  4363 raft_consensus.cc:2393] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:03.354655  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.359239  4555 tablet_bootstrap.cc:654] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.359866  4562 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:03.360500  4872 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.376176  4562 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:03.376652  4562 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.397199  4556 tablet_bootstrap.cc:492] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.397738  4556 ts_tablet_manager.cc:1403] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.003s
I20260709 12:13:03.365185  4576 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.405786  4576 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.413074  4441 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:03.413297  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.418437  4576 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.447062  4576 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.421020  4562 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.449671  4562 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.432665  4556 raft_consensus.cc:359] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.436439  4557 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:03.451442  4557 ts_tablet_manager.cc:1403] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.321s	user 0.023s	sys 0.029s
I20260709 12:13:03.442510  4261 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.454082  4557 raft_consensus.cc:359] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.445518  4555 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.447538  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:03.454963  4556 raft_consensus.cc:385] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.455302  4556 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
W20260709 12:13:03.420320  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 71142.9us
I20260709 12:13:03.455955  4555 ts_tablet_manager.cc:1403] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.000s
I20260709 12:13:03.458499  4576 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.455924  4556 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.458753  4264 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:03.460597  4481 leader_election.cc:343] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.473548  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.473652  4263 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.481858  4515 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:03.483232  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.484078  4801 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.484606  4801 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:03.485617  4801 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.491245  4915 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.491801  4915 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.493453  4915 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.460705  4556 ts_tablet_manager.cc:1434] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.003s
I20260709 12:13:03.461251  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.494704  4511 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.494889  4556 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.464066  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.498883  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.467988  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.462844  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.500207  4357 raft_consensus.cc:2393] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:03.499787  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.499802  4439 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:03.501863  4515 raft_consensus.cc:2393] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:03.461504  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.503049  4366 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.503254  4511 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:03.455957  4809 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.454746  4557 raft_consensus.cc:385] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.504694  4557 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.504294  4555 raft_consensus.cc:359] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.505108  4555 raft_consensus.cc:385] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.505405  4555 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.505479  4557 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.506174  4555 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.508394  4557 ts_tablet_manager.cc:1434] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 12:13:03.508248  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.509636  4576 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.509982  4576 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.510318  4576 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.509059  4809 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:03.511430  4809 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.516104  4557 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:03.528343  4331 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.529240  4915 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.530179  4759 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.530711  4759 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.533277  4759 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.534389  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.534688  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.535391  4439 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:03.536499  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.537238  4759 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:03.537952  4759 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.538560  4759 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.542465  4637 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.544993  4915 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.519201  4576 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.519327  4366 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:03.508282  4555 ts_tablet_manager.cc:1434] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 12:13:03.548496  4555 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
W20260709 12:13:03.522751  4481 leader_election.cc:343] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.521294  4556 tablet_bootstrap.cc:654] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.550837  4481 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:03.552105  4743 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.553171  4743 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:03.555676  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.556012  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.554730  4576 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.556336  4436 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.555711  4743 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.557227  4481 leader_election.cc:343] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.559301  4557 tablet_bootstrap.cc:654] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.558905  4759 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.562969  4759 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.563263  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.564318  4439 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.566313  4436 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:03.568076  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.570109  4611 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.570560  4611 raft_consensus.cc:697] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:03.571264  4611 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.575994  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:03.581094  4407 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:03.554205  4263 catalog_manager.cc:5697] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.585843  4439 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:03.562083  4261 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.587008  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.587987  4759 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:03.588471  4759 raft_consensus.cc:697] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:03.589522  4759 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.595163  4809 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.603567  4555 tablet_bootstrap.cc:654] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.606928  4743 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.607524  4743 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.609445  4743 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.606901  4556 tablet_bootstrap.cc:492] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.610694  4556 ts_tablet_manager.cc:1403] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.001s
I20260709 12:13:03.616468  4556 raft_consensus.cc:359] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.617230  4556 raft_consensus.cc:385] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.617583  4556 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.617647  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.618458  4365 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:03.620635  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.621076  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.621557  4743 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.622001  4743 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.622006  4439 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:03.622440  4743 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.624264  4261 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.626049  4261 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.618607  4556 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.629479  4743 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.631690  4556 ts_tablet_manager.cc:1434] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:13:03.633574  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:03.635257  4366 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.636413  4557 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:03.636654  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.637292  4439 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.640190  4555 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.636893  4557 ts_tablet_manager.cc:1403] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.128s	user 0.004s	sys 0.008s
I20260709 12:13:03.640775  4555 ts_tablet_manager.cc:1403] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.005s
I20260709 12:13:03.642825  4747 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.643405  4747 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.645509  4556 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.645975  4771 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.633780  4743 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.648151  4366 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:03.659464  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.648656  4555 raft_consensus.cc:359] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.660403  4555 raft_consensus.cc:385] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.660799  4555 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.661536  4555 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.660481  4743 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:03.647374  4557 raft_consensus.cc:359] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.663153  4557 raft_consensus.cc:385] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.663468  4557 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.663704  4743 raft_consensus.cc:697] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:03.664415  4557 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.657603  4263 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.666638  4557 ts_tablet_manager.cc:1434] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:13:03.667550  4557 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:03.665657  4743 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.652760  4439 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:03.671947  4555 ts_tablet_manager.cc:1434] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:13:03.672972  4555 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.674569  4747 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:03.676105  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.678936  4555 tablet_bootstrap.cc:654] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:03.679332  4481 leader_election.cc:343] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.681181  4809 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.689172  4637 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.690425  4557 tablet_bootstrap.cc:654] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.695926  4555 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.696383  4555 ts_tablet_manager.cc:1403] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:13:03.698884  4555 raft_consensus.cc:359] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.699580  4555 raft_consensus.cc:385] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.699867  4555 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.709897  4801 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.710427  4801 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.712582  4801 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.713527  4555 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.715629  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.699896  4556 tablet_bootstrap.cc:654] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.716014  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.716358  4557 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:03.716404  4511 raft_consensus.cc:2393] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:03.717348  4557 ts_tablet_manager.cc:1403] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 12:13:03.720086  4557 raft_consensus.cc:359] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.720742  4557 raft_consensus.cc:385] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.721021  4557 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.721678  4557 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.722961  4481 leader_election.cc:343] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.723424  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:03.723825  4555 ts_tablet_manager.cc:1434] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:13:03.724079  4747 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.724833  4555 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.728130  4436 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.731382  4555 tablet_bootstrap.cc:654] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.731489  4556 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.731953  4556 ts_tablet_manager.cc:1403] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.004s
I20260709 12:13:03.735261  4557 ts_tablet_manager.cc:1434] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:13:03.736199  4557 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Bootstrap starting.
I20260709 12:13:03.738484  4809 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.740679  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.742353  4557 tablet_bootstrap.cc:654] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.734473  4556 raft_consensus.cc:359] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.746003  4556 raft_consensus.cc:385] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.746311  4556 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.747089  4556 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.747648  4555 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.748208  4555 ts_tablet_manager.cc:1403] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:13:03.749241  4556 ts_tablet_manager.cc:1434] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:03.750115  4556 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.750774  4555 raft_consensus.cc:359] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.751485  4555 raft_consensus.cc:385] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.751750  4555 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.752631  4555 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.755481  4557 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: No bootstrap required, opened a new log
I20260709 12:13:03.755936  4557 ts_tablet_manager.cc:1403] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 12:13:03.756762  4555 ts_tablet_manager.cc:1434] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:03.758481  4555 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.757668  4407 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.761879  4809 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.770581  4557 raft_consensus.cc:359] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.771512  4557 raft_consensus.cc:385] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.771857  4557 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.779101  4557 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.789951  4556 tablet_bootstrap.cc:654] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.792069  4562 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:03.793110  4557 ts_tablet_manager.cc:1434] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:13:03.794039  4759 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.792200  4263 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.794607  4759 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.804399  4771 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.806265  4365 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.811750  4759 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.814544  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:03.815322  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.815943  4513 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:03.820536  4555 tablet_bootstrap.cc:654] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.821425  4331 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.823305  4759 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:03.823670  4759 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.824002  4759 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.838712  4562 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.839475  4562 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.841275  4562 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.842528  4556 tablet_bootstrap.cc:492] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.843214  4556 ts_tablet_manager.cc:1403] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.021s
I20260709 12:13:03.846957  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.849035  4556 raft_consensus.cc:359] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.850330  4556 raft_consensus.cc:385] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.850512  4556 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.851329  4556 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.853665  4556 ts_tablet_manager.cc:1434] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:13:03.854604  4556 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:03.849730  4366 raft_consensus.cc:1240] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:03.857673  4771 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:03.859197  4759 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.861258  4759 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.866307  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.867168  4363 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:03.869427  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:03.870021  4515 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.872406  4407 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:03.875241  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:03.878212  4637 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.883502  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 57639us
I20260709 12:13:03.888768  4515 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:03.897455  4611 consensus_queue.cc:1059] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.898141  4611 consensus_queue.cc:1243] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:03.906726  4331 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.909159  4915 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:03.909688  4915 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:03.910305  4881 raft_consensus.cc:3055] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:03.910743  4881 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:03.910538  4915 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.911566  4881 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.912943  4881 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.918712  4555 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:03.919236  4555 ts_tablet_manager.cc:1403] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.009s
I20260709 12:13:03.919782  4801 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.920266  4801 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.921645  4637 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.922247  4801 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:03.922406  4439 raft_consensus.cc:1240] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:03.930552  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:03.931270  4508 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:03.931890  4555 raft_consensus.cc:359] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.932611  4555 raft_consensus.cc:385] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.932931  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:03.933983  4637 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.934367  4637 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.934705  4637 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.932931  4555 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.936714  4556 tablet_bootstrap.cc:654] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.937073  4555 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:03.938915  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 66598.3us
I20260709 12:13:03.942613  4555 ts_tablet_manager.cc:1434] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:13:03.943626  4555 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Bootstrap starting.
I20260709 12:13:03.947238  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:03.947922  4366 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
I20260709 12:13:03.966121  4357 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.976291  4555 tablet_bootstrap.cc:654] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.977357  4261 catalog_manager.cc:5697] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.992813  4556 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:03.994431  4556 ts_tablet_manager.cc:1403] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.140s	user 0.018s	sys 0.005s
I20260709 12:13:03.996933  4556 raft_consensus.cc:359] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:03.997591  4556 raft_consensus.cc:385] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.000645  4556 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.001293  4556 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.003274  4556 ts_tablet_manager.cc:1434] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:04.004156  4556 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:04.004572  4637 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.011195  4556 tablet_bootstrap.cc:654] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.014068  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.017266  4362 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.025959  4637 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.032166  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:04.032809  4515 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.039994  4915 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.049896  4515 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:04.051820  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:04.052678  4637 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.052920  4555 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: No bootstrap required, opened a new log
I20260709 12:13:04.053244  4637 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:04.053769  4555 ts_tablet_manager.cc:1403] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.009s
I20260709 12:13:04.054267  4637 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.057850  4363 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:04.016778  4357 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.063478  4743 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.056758  4555 raft_consensus.cc:359] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.080385  4759 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.080956  4555 raft_consensus.cc:385] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.081292  4555 raft_consensus.cc:740] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.075058  4556 tablet_bootstrap.cc:492] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:04.082226  4556 ts_tablet_manager.cc:1403] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.034s
I20260709 12:13:04.089561  4357 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:04.082163  4555 consensus_queue.cc:260] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.091782  4743 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.093907  4555 ts_tablet_manager.cc:1434] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 12:13:04.094854  4562 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.095570  4562 consensus_queue.cc:1243] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:13:04.095959  4562 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:04.096259  4562 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:04.096984  4562 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.098855  4562 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:04.099293  4515 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:04.112375  4801 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.112879  4801 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.114599  4556 raft_consensus.cc:359] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.115324  4556 raft_consensus.cc:385] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.115921  4556 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.116685  4556 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.120128  4801 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.121881  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:04.122788  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:04.123467  4508 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 0.
W20260709 12:13:04.124531  4407 leader_election.cc:343] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.127671  4406 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.128415  4801 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.128759  4515 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:04.129143  4515 pending_rounds.cc:85] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 1
I20260709 12:13:04.129451  4515 pending_rounds.cc:107] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:04.129724  4515 raft_consensus.cc:2889] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:04.131059  4747 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.130975  4915 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.131595  4747 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.133697  4747 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.128774  4801 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.134814  4556 ts_tablet_manager.cc:1434] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
W20260709 12:13:04.135174  4312 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:04.135152  4801 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.137461  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.138082  4441 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:04.138775  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:04.139401  4363 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:04.141158  4556 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:04.143033  4801 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.145593  4801 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.149501  4441 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:04.150914  4915 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.151574  4741 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.152129  4741 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.154109  4741 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.159423  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.160534  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:04.160985  4407 leader_election.cc:343] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.161118  4515 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.164568  4481 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:04.165578  4743 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.165967  4743 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.166296  4743 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.176781  4743 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.179636  4556 tablet_bootstrap.cc:654] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.200146  4556 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:04.200865  4556 ts_tablet_manager.cc:1403] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.000s
I20260709 12:13:04.203927  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:04.204025  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.204944  4439 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:04.206377  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.206974  4357 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.207726  4556 raft_consensus.cc:359] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.210346  4556 raft_consensus.cc:385] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.210776  4556 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.211838  4556 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.213922  4357 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:04.216948  4556 ts_tablet_manager.cc:1434] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:13:04.218437  4556 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:04.224581  4741 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.228135  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:04.230079  4515 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:04.231303  4406 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.231527  4264 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.232331  4637 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.232250  4556 tablet_bootstrap.cc:654] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.233091  4637 raft_consensus.cc:697] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:04.233933  4637 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.237268  4747 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.237684  4747 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.237996  4747 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.240898  4881 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.241542  4743 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.257376  4743 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.257902  4743 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.259745  4556 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:04.260003  4743 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.260592  4556 ts_tablet_manager.cc:1403] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.001s
I20260709 12:13:04.263228  4556 raft_consensus.cc:359] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.264129  4556 raft_consensus.cc:385] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.264503  4556 raft_consensus.cc:740] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.265367  4556 consensus_queue.cc:260] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.267242  4556 ts_tablet_manager.cc:1434] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:13:04.267485  4881 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.268163  4556 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
W20260709 12:13:04.272475  4481 leader_election.cc:343] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.273422  4481 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:04.263875  4747 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.275914  4741 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.276394  4741 raft_consensus.cc:697] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:04.277817  4741 consensus_queue.cc:237] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.281438  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:04.283715  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.284323  4439 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:04.288786  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:04.290089  4441 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:04.290880  4481 leader_election.cc:343] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.291477  4556 tablet_bootstrap.cc:654] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.298115  4481 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.298955  4611 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.299510  4611 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.299824  4611 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.309104  4441 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:04.321979  4576 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.320232  4611 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.327952  4611 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.328630  4441 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:04.329039  4441 pending_rounds.cc:85] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Aborting all ops after (but not including) 1
I20260709 12:13:04.329293  4441 pending_rounds.cc:107] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:04.329528  4441 raft_consensus.cc:2889] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:04.331149  4809 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.332846  4747 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.352169  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.360641  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:04.360925  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.361423  4437 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.363969  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:04.364637  4439 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.381235  4747 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.381959  4481 leader_election.cc:343] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.381779  4747 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.381659  4264 catalog_manager.cc:5697] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.383826  4747 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.384261  4556 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:04.384418  4809 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.384946  4809 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.386343  4556 ts_tablet_manager.cc:1403] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.008s
I20260709 12:13:04.387765  4260 catalog_manager.cc:5697] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.395047  4556 raft_consensus.cc:359] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.398448  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.399232  4436 raft_consensus.cc:2468] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 0.
W20260709 12:13:04.400400  4481 leader_election.cc:343] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.403153  4556 raft_consensus.cc:385] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.403740  4556 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.404340  4556 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.405647  4556 ts_tablet_manager.cc:1434] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:13:04.406577  4556 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Bootstrap starting.
I20260709 12:13:04.410072  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:04.415490  4515 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:04.414014  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:04.416486  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.420857  4438 raft_consensus.cc:2468] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 0.
I20260709 12:13:04.414572  4437 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:04.416659  4916 raft_consensus.cc:2804] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.424292  4916 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.426709  4916 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.435941  4481 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:04.419263  4759 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:04.437214  4743 raft_consensus.cc:2804] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.437783  4743 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.438139  4743 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.438807  4439 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:04.440379  4915 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.440677  4809 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.440894  4915 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.443771  4915 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.449098  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:04.443894  4916 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.450153  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:04.450721  4358 raft_consensus.cc:2393] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:04.451035  4513 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:04.453955  4916 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.455648  4556 tablet_bootstrap.cc:654] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.455760  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:04.462438  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.468094  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:04.470168  4916 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.476548  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:04.477259  4439 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.488245  4637 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.490411  4916 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.498554  4439 raft_consensus.cc:2468] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:04.501048  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:04.506639  4916 raft_consensus.cc:2804] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.506696  4481 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.507529  4916 raft_consensus.cc:697] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:04.508904  4916 consensus_queue.cc:237] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.511804  4743 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.513443  4508 raft_consensus.cc:2393] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:04.515733  4611 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.516386  4611 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:04.517369  4611 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.527763  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.528992  4741 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.529639  4741 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:04.530750  4741 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.550375  4801 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.567533  4556 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: No bootstrap required, opened a new log
I20260709 12:13:04.568041  4556 ts_tablet_manager.cc:1403] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Time spent bootstrapping tablet: real 0.162s	user 0.051s	sys 0.062s
I20260709 12:13:04.564338  4743 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:04.569625  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:04.570554  4439 raft_consensus.cc:2393] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 1: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:04.570869  4556 raft_consensus.cc:359] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.571552  4556 raft_consensus.cc:385] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.571810  4556 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.572477  4556 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.574894  4556 ts_tablet_manager.cc:1434] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:04.582297  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:04.588126  4481 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:04.588923  4611 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.590545  4264 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.592424  4264 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.727145  4262 catalog_manager.cc:5697] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.740754  4801 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.757396  4916 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.758354  4916 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.762833  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.764204  4435 raft_consensus.cc:2393] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:04.767306  4916 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.772918  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:04.780648  4331 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:04.783247  4916 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.822235  4916 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:04.822608  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46578.6us
I20260709 12:13:04.835544  4941 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.841627  4944 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.871135  4743 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.877863  4916 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.878463  4916 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:04.880833  4916 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:04.883085  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:04.884078  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:04.884984  4439 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 1: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:04.886452  4332 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:04.887449  4759 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.894639  4759 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.958326  4915 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.972043  4759 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:04.980789  4743 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.007798  4741 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.039969  4741 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.063627  4747 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.458244  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:05.489177  4985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.489523  4986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:05.490003  4988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:05.491755  3211 server_base.cc:1061] running on GCE node
I20260709 12:13:05.493692  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:05.493978  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:05.494251  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599185494229 us; error 0 us; skew 500 ppm
I20260709 12:13:05.495302  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:05.498875  3211 webserver.cc:533] Webserver started at http://127.3.34.196:33487/ using document root <none> and password file <none>
I20260709 12:13:05.499439  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:05.499632  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:05.500022  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:05.501794  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-3-root/instance:
uuid: "133eea4ce99644f5adbd12c985fc95cb"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-x5d7"
I20260709 12:13:05.507732  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:13:05.512598  4993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.513652  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:13:05.513945  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
uuid: "133eea4ce99644f5adbd12c985fc95cb"
format_stamp: "Formatted at 2026-07-09 12:13:05 on dist-test-slave-x5d7"
I20260709 12:13:05.514232  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:05.555707  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:05.557046  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:05.559609  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:05.562492  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:05.562701  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:05.563038  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:05.563277  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:13:05.642164  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.196:34969
I20260709 12:13:05.642262  5055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.196:34969 every 8 connection(s)
I20260709 12:13:05.651283  3211 auto_leader_rebalancer-test.cc:439] add a tserver: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:05.668601  5056 heartbeater.cc:344] Connected to a master server at 127.3.34.254:42447
I20260709 12:13:05.669131  5056 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:05.670258  5056 heartbeater.cc:507] Master 127.3.34.254:42447 requested a full tablet report, sending...
I20260709 12:13:05.672792  4261 ts_manager.cc:194] Registered new tserver with Master: 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:05.674835  4261 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37796
I20260709 12:13:06.294884  4515 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.303264  4436 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.303661  4362 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.305202  4743 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:06.306236  4741 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:06.318634  4479 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c27395ba03b841e5969f26a9b223fe7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.319453  4741 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.321049  4436 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.324903  4363 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.341897  4511 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.348548  4261 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:06.364269  4479 consensus_peers.cc:597] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a003a2ac88974139bde682ffd3dea64c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.364490  4435 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.366106  4743 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.366339  4362 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.367918  5063 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.377866  5063 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.379611  4435 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.400947  4363 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.430694  4363 consensus_queue.cc:237] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.455159  4511 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.449690  4264 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.457247  4915 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.458387  4435 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.460278  4915 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.495280  4915 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.497488  4436 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.512606  4511 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.532096  4261 catalog_manager.cc:5697] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:06.533898  4330 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a539d67362a4305b85e3c294bc7c2a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.551602  4363 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:06.559881  4330 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb845b83c8c64fc6add1f32cc9fd1f12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.560535  4511 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.560539  4436 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:06.561964  4915 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.562767  5082 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:06.578907  4916 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.580574  4511 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.580415  4439 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:06.597342  4262 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.677543  5056 heartbeater.cc:499] Master 127.3.34.254:42447 was elected leader, sending a full tablet report...
I20260709 12:13:06.686117  5086 ts_tablet_manager.cc:933] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:06.689402  5086 tablet_copy_client.cc:323] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:06.704182  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet c27395ba03b841e5969f26a9b223fe7d from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:06.704838  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet c27395ba03b841e5969f26a9b223fe7d from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-c27395ba03b841e5969f26a9b223fe7d
I20260709 12:13:06.718812  4525 tablet_copy_source_session.cc:215] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.723510  5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27395ba03b841e5969f26a9b223fe7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.736578  5086 tablet_copy_client.cc:806] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.737295  5086 tablet_copy_client.cc:670] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.741564  5086 tablet_copy_client.cc:538] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.748335  5086 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:06.765767  5089 ts_tablet_manager.cc:933] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:06.773711  5086 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.776259  5086 tablet_bootstrap.cc:492] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:06.777611  5086 ts_tablet_manager.cc:1403] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.006s
I20260709 12:13:06.776743  5089 tablet_copy_client.cc:323] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:06.780567  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet a003a2ac88974139bde682ffd3dea64c from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:06.781131  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet a003a2ac88974139bde682ffd3dea64c from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-a003a2ac88974139bde682ffd3dea64c
I20260709 12:13:06.780792  5086 raft_consensus.cc:359] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.781698  5086 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:06.782407  5086 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.793079  4525 tablet_copy_source_session.cc:215] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.797320  5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a003a2ac88974139bde682ffd3dea64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.798633  5086 ts_tablet_manager.cc:1434] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 12:13:06.800841  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c27395ba03b841e5969f26a9b223fe7d received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:06.801424  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c27395ba03b841e5969f26a9b223fe7d on tablet c27395ba03b841e5969f26a9b223fe7d with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:06.814808  5089 tablet_copy_client.cc:806] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.816718  5089 tablet_copy_client.cc:670] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.821200  5089 tablet_copy_client.cc:538] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.827373  5089 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:06.850757  5089 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.851770  5089 tablet_bootstrap.cc:492] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:06.852494  5089 ts_tablet_manager.cc:1403] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 12:13:06.855496  5089 raft_consensus.cc:359] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.856350  5089 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:06.857005  5089 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.861620  5086 ts_tablet_manager.cc:933] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:06.863803  5089 ts_tablet_manager.cc:1434] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.004s
I20260709 12:13:06.865635  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a003a2ac88974139bde682ffd3dea64c received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:06.866066  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a003a2ac88974139bde682ffd3dea64c on tablet a003a2ac88974139bde682ffd3dea64c with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:06.866360  5086 tablet_copy_client.cc:323] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:06.878630  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 9a539d67362a4305b85e3c294bc7c2a8 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:06.879271  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 9a539d67362a4305b85e3c294bc7c2a8 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-9a539d67362a4305b85e3c294bc7c2a8
I20260709 12:13:06.891350  4376 tablet_copy_source_session.cc:215] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:06.897035  5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a539d67362a4305b85e3c294bc7c2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:06.912914  5086 tablet_copy_client.cc:806] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.913615  5086 tablet_copy_client.cc:670] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.919461  5086 tablet_copy_client.cc:538] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:06.931354  5086 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:06.965618  5086 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:06.966611  5086 tablet_bootstrap.cc:492] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:06.967371  5086 ts_tablet_manager.cc:1403] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.018s
I20260709 12:13:06.971215  5086 raft_consensus.cc:359] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.972038  5086 raft_consensus.cc:740] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:06.972694  5086 consensus_queue.cc:260] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:06.975024  5086 ts_tablet_manager.cc:1434] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:06.978323  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-9a539d67362a4305b85e3c294bc7c2a8 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:06.978816  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-9a539d67362a4305b85e3c294bc7c2a8 on tablet 9a539d67362a4305b85e3c294bc7c2a8 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:06.997463  5086 ts_tablet_manager.cc:933] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:06.999871  5086 tablet_copy_client.cc:323] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:07.002182  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet cb845b83c8c64fc6add1f32cc9fd1f12 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:07.002732  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet cb845b83c8c64fc6add1f32cc9fd1f12 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-cb845b83c8c64fc6add1f32cc9fd1f12
I20260709 12:13:07.009742  4376 tablet_copy_source_session.cc:215] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.012337  5086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb845b83c8c64fc6add1f32cc9fd1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.022678  5086 tablet_copy_client.cc:806] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.023293  5086 tablet_copy_client.cc:670] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.027295  5086 tablet_copy_client.cc:538] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.039029  5086 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:07.059813  5086 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.060776  5086 tablet_bootstrap.cc:492] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:07.061452  5086 ts_tablet_manager.cc:1403] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:13:07.064218  5086 raft_consensus.cc:359] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:07.065075  5086 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:07.066334  5086 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:07.068410  5086 ts_tablet_manager.cc:1434] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:07.070266  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-cb845b83c8c64fc6add1f32cc9fd1f12 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:07.070719  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-cb845b83c8c64fc6add1f32cc9fd1f12 on tablet cb845b83c8c64fc6add1f32cc9fd1f12 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:07.188819  5031 raft_consensus.cc:1217] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.279618  5031 raft_consensus.cc:1217] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.381894  5031 raft_consensus.cc:1217] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.501453  5031 raft_consensus.cc:1217] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:07.575207  5063 raft_consensus.cc:1064] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:07.577466  5063 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:07.584091  5031 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.584285  4439 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.585112  4363 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.586153  5063 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.587075  5068 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.587952  4741 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.611922  4741 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.618968  4363 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.626544  5031 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.623111  4439 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.633370  4261 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.688191  4511 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:07.694443  4436 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.697309  5031 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:07.699448  5068 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.703030  5068 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:07.713249  4439 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.711297  4741 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.720438  5031 raft_consensus.cc:2955] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.729334  5099 raft_consensus.cc:1064] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:07.732865  5099 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:07.746773  4262 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.776405  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet a003a2ac88974139bde682ffd3dea64c with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:07.796125  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a003a2ac88974139bde682ffd3dea64c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:07.857306  4439 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.857359  5031 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.858652  4741 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.859530  5099 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.860282  4362 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.867817  5063 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.898015  5108 tablet_replica.cc:333] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:07.899349  5108 raft_consensus.cc:2243] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.900261  4915 raft_consensus.cc:1064] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:07.902333  5108 raft_consensus.cc:2272] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.904220  4915 consensus_queue.cc:237] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:07.908448  5108 ts_tablet_manager.cc:1916] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:07.913002  5063 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.914824  4436 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.929143  5108 ts_tablet_manager.cc:1929] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:07.929800  5108 log.cc:1199] T a003a2ac88974139bde682ffd3dea64c P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/a003a2ac88974139bde682ffd3dea64c
I20260709 12:13:07.931918  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet a003a2ac88974139bde682ffd3dea64c (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:07.933590  5031 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.935375  4915 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.937403  4508 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.943427  4915 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.949064  5030 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.945887  4261 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.967638  4363 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.991776  4436 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:07.992805  5082 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:07.998302  4916 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:07.996131  4508 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.008540  5030 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.020491  4915 raft_consensus.cc:1064] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:08.023074  4915 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:08.030930  4439 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.052008  5030 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.055598  4916 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.058174  4511 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.059854  5119 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:08.063231  4261 catalog_manager.cc:5697] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.065620  4435 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.069264  4916 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:08.091154  5119 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.095858  4511 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.114672  4261 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:08.156999  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 89427.1us
I20260709 12:13:08.183704  4435 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.207779  4508 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:08.218680  5030 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.220096  5099 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.222288  4357 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.223714  5099 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.228214  5063 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.231236  5031 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.234622  4357 raft_consensus.cc:2955] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.240818  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c27395ba03b841e5969f26a9b223fe7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.246881  4264 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.257879  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet c27395ba03b841e5969f26a9b223fe7d with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:08.264187  5125 tablet_replica.cc:333] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:08.266474  5125 raft_consensus.cc:2243] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.267267  5125 raft_consensus.cc:2272] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.270880  5125 ts_tablet_manager.cc:1916] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.285935  5125 ts_tablet_manager.cc:1929] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.286434  5125 log.cc:1199] T c27395ba03b841e5969f26a9b223fe7d P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/c27395ba03b841e5969f26a9b223fe7d
I20260709 12:13:08.288141  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet c27395ba03b841e5969f26a9b223fe7d (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:08.500131  4363 consensus_queue.cc:237] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:08.505838  4439 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.505964  5031 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.507337  5119 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.508948  5119 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.514477  5124 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.517657  4435 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.521838  5031 raft_consensus.cc:2955] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.539264  4264 catalog_manager.cc:5697] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.543582  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a539d67362a4305b85e3c294bc7c2a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.569902  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a539d67362a4305b85e3c294bc7c2a8 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:08.600705  5126 tablet_replica.cc:333] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:08.602219  5126 raft_consensus.cc:2243] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.602929  5126 raft_consensus.cc:2272] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.606632  5126 ts_tablet_manager.cc:1916] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.624500  5126 ts_tablet_manager.cc:1929] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.625023  5126 log.cc:1199] T 9a539d67362a4305b85e3c294bc7c2a8 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/9a539d67362a4305b85e3c294bc7c2a8
I20260709 12:13:08.626905  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 9a539d67362a4305b85e3c294bc7c2a8 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:08.656442  5031 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.668582  4357 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:08.683605  4435 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.685573  5122 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.688411  5030 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.692129  5122 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.697142  5124 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.708482  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb845b83c8c64fc6add1f32cc9fd1f12 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.708400  4435 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.710638  5031 raft_consensus.cc:2955] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:08.724350  4264 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.741700  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet cb845b83c8c64fc6add1f32cc9fd1f12 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:08.742821  5126 tablet_replica.cc:333] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:08.744001  5126 raft_consensus.cc:2243] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.744773  5126 raft_consensus.cc:2272] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.748776  5126 ts_tablet_manager.cc:1916] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.765573  5126 ts_tablet_manager.cc:1929] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.766148  5126 log.cc:1199] T cb845b83c8c64fc6add1f32cc9fd1f12 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/cb845b83c8c64fc6add1f32cc9fd1f12
I20260709 12:13:08.767863  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet cb845b83c8c64fc6add1f32cc9fd1f12 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:09.818691  4357 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:09.825276  4511 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:09.825603  4330 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8afbdad4342642f89b3c8be7ce7da5dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.826342  4439 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.826706  5128 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.829355  5128 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.834650  5124 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.836443  4511 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.845495  4435 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.850888  4262 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.900599  4435 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:09.909991  4511 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.910356  4357 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:09.911723  4975 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.921370  5127 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:09.930953  5127 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.935330  4511 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.946808  4357 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.958953  4264 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:09.979501  4511 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:09.987039  4405 consensus_peers.cc:597] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19356d2adb334f6fa9ec07c452d14046. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:10.015046  4479 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 049f37cd99a74aec952c95bcc63588b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.019207  4357 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.020102  4435 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.021361  5114 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.022553  5129 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.032342  5114 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.033836  4357 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.035964  4433 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.050547  4433 consensus_queue.cc:237] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.056557  4261 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:10.078320  4405 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4c35d8d5d0b41aca58011ae22cd5c02. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.081525  4511 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.082559  4357 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.083583  5142 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.085809  5141 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.094971  5142 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.096776  4508 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.102648  4357 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.115988  4264 catalog_manager.cc:5697] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:10.206533  5153 ts_tablet_manager.cc:933] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:10.208484  5153 tablet_copy_client.cc:323] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:10.210620  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 8afbdad4342642f89b3c8be7ce7da5dc from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:10.211186  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 8afbdad4342642f89b3c8be7ce7da5dc from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-8afbdad4342642f89b3c8be7ce7da5dc
I20260709 12:13:10.217828  4376 tablet_copy_source_session.cc:215] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.220952  5153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afbdad4342642f89b3c8be7ce7da5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.233840  5153 tablet_copy_client.cc:806] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.234478  5153 tablet_copy_client.cc:670] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.240226  5153 tablet_copy_client.cc:538] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.247532  5153 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:10.265506  5153 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.266484  5153 tablet_bootstrap.cc:492] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:10.267262  5153 ts_tablet_manager.cc:1403] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 12:13:10.270290  5153 raft_consensus.cc:359] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.272823  5153 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:10.273732  5153 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.294950  5153 ts_tablet_manager.cc:1434] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.012s
I20260709 12:13:10.300151  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-8afbdad4342642f89b3c8be7ce7da5dc received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:10.300619  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-8afbdad4342642f89b3c8be7ce7da5dc on tablet 8afbdad4342642f89b3c8be7ce7da5dc with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:10.436466  5153 ts_tablet_manager.cc:933] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:10.438313  5153 tablet_copy_client.cc:323] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:10.452037  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 19356d2adb334f6fa9ec07c452d14046 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:10.452699  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 19356d2adb334f6fa9ec07c452d14046 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-19356d2adb334f6fa9ec07c452d14046
I20260709 12:13:10.461238  4451 tablet_copy_source_session.cc:215] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.465469  5153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19356d2adb334f6fa9ec07c452d14046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.465924  5160 ts_tablet_manager.cc:933] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:10.474278  5160 tablet_copy_client.cc:323] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:10.477883  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet 049f37cd99a74aec952c95bcc63588b9 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:10.478443  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet 049f37cd99a74aec952c95bcc63588b9 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-049f37cd99a74aec952c95bcc63588b9
I20260709 12:13:10.486486  5153 tablet_copy_client.cc:806] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.486675  4525 tablet_copy_source_session.cc:215] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.487196  5153 tablet_copy_client.cc:670] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.490106  5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049f37cd99a74aec952c95bcc63588b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.490923  5153 tablet_copy_client.cc:538] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.501798  5153 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:10.507555  5160 tablet_copy_client.cc:806] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.508242  5160 tablet_copy_client.cc:670] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.512054  5160 tablet_copy_client.cc:538] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.523731  5160 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:10.537083  5153 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.538046  5153 tablet_bootstrap.cc:492] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:10.539098  5153 ts_tablet_manager.cc:1403] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.005s
I20260709 12:13:10.542434  5153 raft_consensus.cc:359] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.543393  5153 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:10.544094  5153 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.546836  5153 ts_tablet_manager.cc:1434] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:10.551008  5160 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.552001  5160 tablet_bootstrap.cc:492] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:10.552699  5160 ts_tablet_manager.cc:1403] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.009s
I20260709 12:13:10.552986  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-19356d2adb334f6fa9ec07c452d14046 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:10.553452  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-19356d2adb334f6fa9ec07c452d14046 on tablet 19356d2adb334f6fa9ec07c452d14046 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:10.560117  5160 raft_consensus.cc:359] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.561547  5160 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:10.562247  5160 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.568310  5160 ts_tablet_manager.cc:1434] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:13:10.572445  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-049f37cd99a74aec952c95bcc63588b9 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:10.572878  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-049f37cd99a74aec952c95bcc63588b9 on tablet 049f37cd99a74aec952c95bcc63588b9 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:10.593652  5160 ts_tablet_manager.cc:933] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:10.603416  5160 tablet_copy_client.cc:323] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:10.604883  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet f4c35d8d5d0b41aca58011ae22cd5c02 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:10.605360  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet f4c35d8d5d0b41aca58011ae22cd5c02 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-f4c35d8d5d0b41aca58011ae22cd5c02
I20260709 12:13:10.611092  4451 tablet_copy_source_session.cc:215] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:10.614135  5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c35d8d5d0b41aca58011ae22cd5c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.628299  5160 tablet_copy_client.cc:806] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:10.628928  5160 tablet_copy_client.cc:670] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:10.633193  5160 tablet_copy_client.cc:538] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:10.645749  5160 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:10.655012  5030 raft_consensus.cc:1217] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.685775  5160 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:10.686676  5160 tablet_bootstrap.cc:492] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:10.687358  5160 ts_tablet_manager.cc:1403] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.042s	user 0.031s	sys 0.009s
I20260709 12:13:10.690199  5160 raft_consensus.cc:359] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.691097  5160 raft_consensus.cc:740] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:10.691785  5160 consensus_queue.cc:260] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:10.694116  5160 ts_tablet_manager.cc:1434] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:10.697620  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-f4c35d8d5d0b41aca58011ae22cd5c02 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:10.698045  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-f4c35d8d5d0b41aca58011ae22cd5c02 on tablet f4c35d8d5d0b41aca58011ae22cd5c02 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:10.977553  5030 raft_consensus.cc:1217] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:10.985962  5030 raft_consensus.cc:1217] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:11.009797  5030 raft_consensus.cc:1217] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:11.197643  5169 raft_consensus.cc:1064] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:11.200665  5169 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.212054  5030 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.212522  4435 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.213580  5169 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.215070  5131 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.217720  4511 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.242054  5131 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.252341  5169 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.253636  4511 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.255609  4433 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.265560  5030 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.289059  4261 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.311374  4363 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.315717  5030 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.315712  4511 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.317380  5169 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.318284  5131 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.327533  5166 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.330454  5030 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.361022  4262 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.375990  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8afbdad4342642f89b3c8be7ce7da5dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.385987  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afbdad4342642f89b3c8be7ce7da5dc with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:11.401444  4511 raft_consensus.cc:2955] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.417169  4975 raft_consensus.cc:1064] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:11.421530  4975 consensus_queue.cc:237] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.433879  5114 raft_consensus.cc:1064] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:11.426699  5183 tablet_replica.cc:333] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:11.436573  5114 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.439340  5183 raft_consensus.cc:2243] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.440029  5183 raft_consensus.cc:2272] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.445338  4362 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.446086  5030 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.446424  4515 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.447906  5142 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.448737  5141 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.452790  5142 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:11.462875  5142 raft_consensus.cc:1064] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:11.472183  5142 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.492249  5183 ts_tablet_manager.cc:1916] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.506134  4357 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.508213  5164 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.508646  5030 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.510737  5063 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:11.523753  4433 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.542687  5114 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:13:11.565841  4975 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.581564  5029 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.588500  4511 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.581969  4362 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.612409  5141 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:11.621989  5183 ts_tablet_manager.cc:1929] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.613930  5194 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.628283  5183 log.cc:1199] T 8afbdad4342642f89b3c8be7ce7da5dc P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/8afbdad4342642f89b3c8be7ce7da5dc
I20260709 12:13:11.643194  4262 catalog_manager.cc:5697] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.631543  5031 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.657037  4508 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.667110  4357 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.673849  5030 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.679615  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 8afbdad4342642f89b3c8be7ce7da5dc (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:11.686326  4264 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.688058  4435 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.690495  5192 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:11.709221  4358 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:11.738885  4511 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.751343  5030 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.752872  5129 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.752255  5200 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:11.757710  5142 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.765715  4511 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.767405  5194 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.769338  5031 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.779904  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 049f37cd99a74aec952c95bcc63588b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.784636  4357 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.783510  4262 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.786317  5030 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.793884  4433 consensus_queue.cc:237] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.802423  5030 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.803021  5063 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.806651  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 049f37cd99a74aec952c95bcc63588b9 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:11.807575  5183 tablet_replica.cc:333] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:11.808573  5183 raft_consensus.cc:2243] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.809314  5195 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:11.810828  5183 raft_consensus.cc:2272] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.812953  4264 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.822207  4358 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.824113  5192 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.825505  5183 ts_tablet_manager.cc:1916] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.824927  4363 raft_consensus.cc:2955] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.829756  5031 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.837996  5142 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.844622  4362 raft_consensus.cc:2955] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.860862  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4c35d8d5d0b41aca58011ae22cd5c02 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.869454  4264 catalog_manager.cc:5697] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.874229  4435 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:11.875489  4357 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.882890  5031 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.885941  5192 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:11.894928  4508 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:11.897204  5142 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:11.903244  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet f4c35d8d5d0b41aca58011ae22cd5c02 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:11.909072  5192 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.915122  5183 ts_tablet_manager.cc:1929] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:11.922029  5183 log.cc:1199] T 049f37cd99a74aec952c95bcc63588b9 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/049f37cd99a74aec952c95bcc63588b9
I20260709 12:13:11.917939  5030 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.925335  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 049f37cd99a74aec952c95bcc63588b9 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:11.935938  5203 tablet_replica.cc:333] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:11.937664  4508 raft_consensus.cc:2955] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.955761  4260 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:11.959079  5203 raft_consensus.cc:2243] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.963006  5203 raft_consensus.cc:2272] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.971460  5203 ts_tablet_manager.cc:1916] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:11.975158  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19356d2adb334f6fa9ec07c452d14046 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:11.977803  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 19356d2adb334f6fa9ec07c452d14046 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:11.980172  5204 tablet_replica.cc:333] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:11.995273  5204 raft_consensus.cc:2243] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:11.996476  5204 raft_consensus.cc:2272] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:11.999976  5204 ts_tablet_manager.cc:1916] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:12.001163  5203 ts_tablet_manager.cc:1929] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:12.001576  5203 log.cc:1199] T f4c35d8d5d0b41aca58011ae22cd5c02 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/f4c35d8d5d0b41aca58011ae22cd5c02
I20260709 12:13:12.003261  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet f4c35d8d5d0b41aca58011ae22cd5c02 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:12.013595  5204 ts_tablet_manager.cc:1929] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:12.014104  5204 log.cc:1199] T 19356d2adb334f6fa9ec07c452d14046 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/19356d2adb334f6fa9ec07c452d14046
I20260709 12:13:12.015825  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 19356d2adb334f6fa9ec07c452d14046 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:13.052348  4515 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.060000  4435 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:13.060777  4479 consensus_peers.cc:597] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a04eae5aed3946b19b6d1c1b40af70ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.061851  5205 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.061904  4357 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.064982  5063 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.075306  5114 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.076463  4435 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.086464  4357 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.095021  4260 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.095295  4515 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:13.104887  4479 consensus_peers.cc:597] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f130dbf22aa4fec863590cd97a47f17. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.106977  4435 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.107138  4357 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.108637  5063 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.109526  5114 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.123593  5114 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.125186  4435 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.137208  4357 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.146569  4362 consensus_queue.cc:237] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.148274  4260 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.161441  4515 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.163456  4435 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.165453  5131 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:13.167502  4330 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3568f45f51034aec8216f626ea0759ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.168054  5131 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:13.179780  5169 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.182382  4435 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.183338  4515 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.192725  4357 consensus_queue.cc:237] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.200129  4262 catalog_manager.cc:5697] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:13.206952  4330 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c050a61816f48f59f2cefc96a79621d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:13.208648  4435 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.213634  4515 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:13.214058  5218 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.215320  5169 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:13.223747  5169 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.225422  4515 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.230113  4435 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:13.241222  4264 catalog_manager.cc:5697] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.630752  5224 ts_tablet_manager.cc:933] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:13.632810  5224 tablet_copy_client.cc:323] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:13.635751  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet 6f130dbf22aa4fec863590cd97a47f17 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:13.636292  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet 6f130dbf22aa4fec863590cd97a47f17 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-6f130dbf22aa4fec863590cd97a47f17
I20260709 12:13:13.641901  4525 tablet_copy_source_session.cc:215] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.645406  5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f130dbf22aa4fec863590cd97a47f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.645496  5226 ts_tablet_manager.cc:933] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:13.647722  5226 tablet_copy_client.cc:323] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:13.649663  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet a04eae5aed3946b19b6d1c1b40af70ca from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:13.650236  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet a04eae5aed3946b19b6d1c1b40af70ca from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-a04eae5aed3946b19b6d1c1b40af70ca
I20260709 12:13:13.658056  4525 tablet_copy_source_session.cc:215] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.661877  5224 tablet_copy_client.cc:806] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.662623  5224 tablet_copy_client.cc:670] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.665158  5228 ts_tablet_manager.cc:933] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:13.667980  5226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04eae5aed3946b19b6d1c1b40af70ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.671504  5228 tablet_copy_client.cc:323] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:13.671736  5224 tablet_copy_client.cc:538] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.673424  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 2c050a61816f48f59f2cefc96a79621d from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:13.673884  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 2c050a61816f48f59f2cefc96a79621d from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-2c050a61816f48f59f2cefc96a79621d
I20260709 12:13:13.684010  4376 tablet_copy_source_session.cc:215] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.688889  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c050a61816f48f59f2cefc96a79621d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.693517  5226 tablet_copy_client.cc:806] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.694583  5226 tablet_copy_client.cc:670] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.701630  5224 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:13.713389  5226 tablet_copy_client.cc:538] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.716975  5230 ts_tablet_manager.cc:933] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:13.722235  5228 tablet_copy_client.cc:806] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.723057  5228 tablet_copy_client.cc:670] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.726241  5226 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:13.729152  5228 tablet_copy_client.cc:538] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.732015  5230 tablet_copy_client.cc:323] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:13.738152  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 3568f45f51034aec8216f626ea0759ea from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:13.738797  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 3568f45f51034aec8216f626ea0759ea from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-3568f45f51034aec8216f626ea0759ea
I20260709 12:13:13.760255  5224 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.761217  5224 tablet_bootstrap.cc:492] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:13.761891  5224 ts_tablet_manager.cc:1403] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.009s
I20260709 12:13:13.763360  5228 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:13.766050  5224 raft_consensus.cc:359] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.766904  5224 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:13.768651  5224 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.774013  4376 tablet_copy_source_session.cc:215] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:13.788333  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3568f45f51034aec8216f626ea0759ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.795537  5224 ts_tablet_manager.cc:1434] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.033s	user 0.017s	sys 0.013s
I20260709 12:13:13.797565  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-6f130dbf22aa4fec863590cd97a47f17 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:13.798023  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-6f130dbf22aa4fec863590cd97a47f17 on tablet 6f130dbf22aa4fec863590cd97a47f17 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:13.813503  5230 tablet_copy_client.cc:806] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:13.818770  5230 tablet_copy_client.cc:670] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:13.828976  5228 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.829165  5226 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.829986  5228 tablet_bootstrap.cc:492] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:13.830149  5226 tablet_bootstrap.cc:492] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:13.830727  5228 ts_tablet_manager.cc:1403] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.015s
I20260709 12:13:13.830907  5226 ts_tablet_manager.cc:1403] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.105s	user 0.033s	sys 0.006s
I20260709 12:13:13.827934  5230 tablet_copy_client.cc:538] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:13.834208  5226 raft_consensus.cc:359] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.834363  5228 raft_consensus.cc:359] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.836850  5226 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:13.836939  5228 raft_consensus.cc:740] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:13.838646  5226 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.839699  5228 consensus_queue.cc:260] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.842195  5226 ts_tablet_manager.cc:1434] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:13:13.841859  5228 ts_tablet_manager.cc:1434] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:13:13.849596  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a04eae5aed3946b19b6d1c1b40af70ca received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:13.850040  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a04eae5aed3946b19b6d1c1b40af70ca on tablet a04eae5aed3946b19b6d1c1b40af70ca with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:13.861528  5230 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:13.883802  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-2c050a61816f48f59f2cefc96a79621d received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:13.884266  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-2c050a61816f48f59f2cefc96a79621d on tablet 2c050a61816f48f59f2cefc96a79621d with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:13.904004  5230 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:13.905105  5230 tablet_bootstrap.cc:492] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:13.905939  5230 ts_tablet_manager.cc:1403] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.012s
I20260709 12:13:13.909003  5230 raft_consensus.cc:359] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.909930  5230 raft_consensus.cc:740] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:13.910647  5230 consensus_queue.cc:260] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:13.914441  5230 ts_tablet_manager.cc:1434] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:13.917127  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3568f45f51034aec8216f626ea0759ea received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:13.917570  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3568f45f51034aec8216f626ea0759ea on tablet 3568f45f51034aec8216f626ea0759ea with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:14.092796  5030 raft_consensus.cc:1217] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.175637  5030 raft_consensus.cc:1217] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.252288  5030 raft_consensus.cc:1217] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.267869  5030 raft_consensus.cc:1217] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:14.642601  5238 raft_consensus.cc:1064] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:14.644757  5238 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:14.652501  5030 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.653885  4363 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.653990  4439 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.655445  5114 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.656610  5063 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.657362  5238 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.670818  5238 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.674887  4363 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.689184  5240 raft_consensus.cc:1064] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:13:14.694953  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.706226  5240 consensus_queue.cc:237] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:14.732941  4262 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.751607  5063 raft_consensus.cc:1064] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:14.772394  5241 raft_consensus.cc:1064] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:14.777957  5241 consensus_queue.cc:237] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:14.676091  5030 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.789376  5031 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.795111  5239 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.798130  5063 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:14.795830  4439 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.811432  5218 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.822921  5029 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.826345  5218 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.880766  5240 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.883692  4433 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:14.888741  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 134457us
I20260709 12:13:14.894568  4508 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.896188  4508 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.900378  4439 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.914443  5240 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.925099  5031 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.928550  5240 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:14.934620  5239 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.948966  5240 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.953821  4433 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.911434  5029 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:14.967828  5251 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:14.970129  4366 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.970640  4435 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:14.977311  4433 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.014165  4508 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.108060  5029 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.093385  4260 catalog_manager.cc:5697] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:15.157120  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 94426.9us
I20260709 12:13:15.160200  5114 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:15.172338  4260 catalog_manager.cc:5697] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:15.185662  5114 consensus_queue.cc:1175] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6b40d129d452470ba95c63b1eb11f804" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 12:13:15.194474  5251 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:15.228448  4511 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.228842  5250 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.230487  4436 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.220815  4508 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:15.274436  5029 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.310672  4264 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.317497  5029 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.320549  5114 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.337028  5261 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.340319  5031 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.359724  4436 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.361577  4515 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:15.363766  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a04eae5aed3946b19b6d1c1b40af70ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.364416  5114 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.367179  4264 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.379231  4436 raft_consensus.cc:2955] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.389070  5029 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.389770  4439 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.390662  4358 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.395051  5250 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.402640  5250 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.405570  4435 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.409710  5261 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:15.418457  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f130dbf22aa4fec863590cd97a47f17 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.425082  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet a04eae5aed3946b19b6d1c1b40af70ca with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:15.426769  4358 consensus_queue.cc:237] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:15.442597  4357 consensus_queue.cc:237] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:15.451830  5029 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.453477  5031 raft_consensus.cc:2955] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.461010  5241 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:15.463605  4439 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.466382  5240 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:15.467953  5029 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.469632  5240 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:15.475539  5276 tablet_replica.cc:333] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:15.476902  5276 raft_consensus.cc:2243] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.480994  4515 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:15.482582  5218 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.484220  5030 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.488067  4264 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.500494  5241 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:15.502115  5239 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.507449  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3568f45f51034aec8216f626ea0759ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.514072  4511 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.515571  5276 raft_consensus.cc:2272] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.517107  4262 catalog_manager.cc:5697] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.522684  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f130dbf22aa4fec863590cd97a47f17 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:15.532112  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 3568f45f51034aec8216f626ea0759ea with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:15.538844  5029 raft_consensus.cc:2955] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.539558  4439 raft_consensus.cc:2955] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.558444  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c050a61816f48f59f2cefc96a79621d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:15.544566  5277 tablet_replica.cc:333] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:15.546216  4264 catalog_manager.cc:5697] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:15.552224  5276 ts_tablet_manager.cc:1916] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.577647  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c050a61816f48f59f2cefc96a79621d with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:15.581552  5276 ts_tablet_manager.cc:1929] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.582106  5276 log.cc:1199] T a04eae5aed3946b19b6d1c1b40af70ca P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/a04eae5aed3946b19b6d1c1b40af70ca
I20260709 12:13:15.584554  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet a04eae5aed3946b19b6d1c1b40af70ca (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:15.585064  5276 tablet_replica.cc:333] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:15.586221  5276 raft_consensus.cc:2243] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.587891  5278 tablet_replica.cc:333] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:15.589202  5278 raft_consensus.cc:2243] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.590204  5278 raft_consensus.cc:2272] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.591163  5276 raft_consensus.cc:2272] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.594937  5276 ts_tablet_manager.cc:1916] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.598498  5278 ts_tablet_manager.cc:1916] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.604173  5277 raft_consensus.cc:2243] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:15.606691  5277 raft_consensus.cc:2272] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:15.611737  5277 ts_tablet_manager.cc:1916] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:15.618247  5276 ts_tablet_manager.cc:1929] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.618695  5276 log.cc:1199] T 6f130dbf22aa4fec863590cd97a47f17 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/6f130dbf22aa4fec863590cd97a47f17
I20260709 12:13:15.620362  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 6f130dbf22aa4fec863590cd97a47f17 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:15.623636  5278 ts_tablet_manager.cc:1929] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.624140  5278 log.cc:1199] T 2c050a61816f48f59f2cefc96a79621d P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/2c050a61816f48f59f2cefc96a79621d
I20260709 12:13:15.626796  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 2c050a61816f48f59f2cefc96a79621d (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:15.628541  5277 ts_tablet_manager.cc:1929] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:15.629015  5277 log.cc:1199] T 3568f45f51034aec8216f626ea0759ea P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/3568f45f51034aec8216f626ea0759ea
I20260709 12:13:15.630587  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 3568f45f51034aec8216f626ea0759ea (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:16.685369  4358 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:16.691668  4435 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.691865  4330 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 632d1ea17544468d8db4dfec9893bc7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.692245  4515 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.692935  5239 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.693943  5256 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.702538  5239 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.704694  4515 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.708912  4435 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.728262  4511 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:16.733089  4262 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:16.740296  4479 consensus_peers.cc:597] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1602309b0f64e5da65bbe212dcd8578. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.741490  4358 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.743454  5238 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.746747  4435 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.751217  5238 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.756258  5252 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.760994  4358 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.778930  4435 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.785316  4439 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:16.795853  4405 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66db2395fb8d472bae50ea6bda5a63f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.797820  4511 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.800604  5243 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.802716  4358 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.804704  5200 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.802071  4264 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.828142  5292 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.830368  4358 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.831789  4511 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.848686  4357 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:16.851243  4261 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.860087  4439 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:16.860133  4511 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:16.861999  5283 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:16.864331  4330 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd282266b4fc4ef98c399a7ea99210df. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.866328  5256 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:16.886406  5240 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.892009  4439 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.910542  4511 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:16.910387  4262 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.191926  5299 ts_tablet_manager.cc:933] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:17.193774  5299 tablet_copy_client.cc:323] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:17.195555  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet c1602309b0f64e5da65bbe212dcd8578 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:17.196038  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet c1602309b0f64e5da65bbe212dcd8578 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-c1602309b0f64e5da65bbe212dcd8578
I20260709 12:13:17.203971  4525 tablet_copy_source_session.cc:215] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.207492  5299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1602309b0f64e5da65bbe212dcd8578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.219156  5299 tablet_copy_client.cc:806] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.219954  5299 tablet_copy_client.cc:670] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.225621  5299 tablet_copy_client.cc:538] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.227708  5301 ts_tablet_manager.cc:933] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:17.235496  5299 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:17.246861  5301 tablet_copy_client.cc:323] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:17.249473  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 66db2395fb8d472bae50ea6bda5a63f8 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:17.250047  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 66db2395fb8d472bae50ea6bda5a63f8 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-66db2395fb8d472bae50ea6bda5a63f8
I20260709 12:13:17.269555  4451 tablet_copy_source_session.cc:215] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.277593  5299 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.278718  5299 tablet_bootstrap.cc:492] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:17.279561  5299 ts_tablet_manager.cc:1403] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.003s
I20260709 12:13:17.283149  5299 raft_consensus.cc:359] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.284227  5299 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:17.284983  5299 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.288658  5299 ts_tablet_manager.cc:1434] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:17.291234  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c1602309b0f64e5da65bbe212dcd8578 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:17.291877  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c1602309b0f64e5da65bbe212dcd8578 on tablet c1602309b0f64e5da65bbe212dcd8578 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:17.298295  5301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66db2395fb8d472bae50ea6bda5a63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.315896  5299 ts_tablet_manager.cc:933] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:17.319093  5301 tablet_copy_client.cc:806] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.319907  5301 tablet_copy_client.cc:670] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.324312  5299 tablet_copy_client.cc:323] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:17.326536  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 632d1ea17544468d8db4dfec9893bc7d from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:17.327256  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 632d1ea17544468d8db4dfec9893bc7d from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-632d1ea17544468d8db4dfec9893bc7d
I20260709 12:13:17.330725  5306 ts_tablet_manager.cc:933] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:17.340945  4376 tablet_copy_source_session.cc:215] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.343660  5301 tablet_copy_client.cc:538] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.343907  5306 tablet_copy_client.cc:323] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:17.345883  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet cd282266b4fc4ef98c399a7ea99210df from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:17.346583  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet cd282266b4fc4ef98c399a7ea99210df from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-cd282266b4fc4ef98c399a7ea99210df
I20260709 12:13:17.347820  5299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632d1ea17544468d8db4dfec9893bc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.354952  4376 tablet_copy_source_session.cc:215] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.355681  5301 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:17.358812  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd282266b4fc4ef98c399a7ea99210df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.385864  5299 tablet_copy_client.cc:806] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.386523  5299 tablet_copy_client.cc:670] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.391072  5299 tablet_copy_client.cc:538] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.394526  5301 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.395624  5301 tablet_bootstrap.cc:492] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:17.396422  5301 ts_tablet_manager.cc:1403] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.011s
I20260709 12:13:17.400745  5301 raft_consensus.cc:359] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.402024  5301 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:17.402848  5301 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.407941  5301 ts_tablet_manager.cc:1434] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:17.411995  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-66db2395fb8d472bae50ea6bda5a63f8 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:17.412480  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-66db2395fb8d472bae50ea6bda5a63f8 on tablet 66db2395fb8d472bae50ea6bda5a63f8 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:17.418402  5306 tablet_copy_client.cc:806] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.419211  5306 tablet_copy_client.cc:670] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.420473  5299 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:17.423357  5306 tablet_copy_client.cc:538] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.433599  5306 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:17.476320  5299 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.477299  5299 tablet_bootstrap.cc:492] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:17.477989  5299 ts_tablet_manager.cc:1403] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.015s
I20260709 12:13:17.482824  5299 raft_consensus.cc:359] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.483748  5299 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:17.484397  5299 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.486935  5299 ts_tablet_manager.cc:1434] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:17.498935  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-632d1ea17544468d8db4dfec9893bc7d received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:17.499471  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-632d1ea17544468d8db4dfec9893bc7d on tablet 632d1ea17544468d8db4dfec9893bc7d with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:17.501374  5306 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.502414  5306 tablet_bootstrap.cc:492] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:17.508687  5306 ts_tablet_manager.cc:1403] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.013s
I20260709 12:13:17.530807  5306 raft_consensus.cc:359] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.531725  5306 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:17.532372  5306 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:17.535108  5306 ts_tablet_manager.cc:1434] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.012s
I20260709 12:13:17.541838  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-cd282266b4fc4ef98c399a7ea99210df received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:17.542300  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-cd282266b4fc4ef98c399a7ea99210df on tablet cd282266b4fc4ef98c399a7ea99210df with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:17.655347  5029 raft_consensus.cc:1217] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.781404  5029 raft_consensus.cc:1217] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.808713  5029 raft_consensus.cc:1217] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.814720  5029 raft_consensus.cc:1217] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:13:18.044359  5316 raft_consensus.cc:1064] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:18.046829  5316 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.057947  5029 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.058105  4435 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.060664  5252 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.061249  4366 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.061709  5238 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.064088  5316 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.095968  5252 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.105607  5029 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.127532  4435 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.126124  4262 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.137882  4357 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.167534  4511 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.181759  4435 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.183254  5252 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:18.189896  5029 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.190474  5252 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.192026  5238 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.195251  4435 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.196623  5029 raft_consensus.cc:2955] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.204775  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1602309b0f64e5da65bbe212dcd8578 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.216233  4264 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.235671  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet c1602309b0f64e5da65bbe212dcd8578 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:18.237746  5326 tablet_replica.cc:333] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:18.238802  5326 raft_consensus.cc:2243] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:18.239609  5326 raft_consensus.cc:2272] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:18.242980  5326 ts_tablet_manager.cc:1916] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:18.257875  5326 ts_tablet_manager.cc:1929] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:18.258245  5326 log.cc:1199] T c1602309b0f64e5da65bbe212dcd8578 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/c1602309b0f64e5da65bbe212dcd8578
I20260709 12:13:18.259788  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet c1602309b0f64e5da65bbe212dcd8578 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:18.276043  5283 raft_consensus.cc:1064] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:18.278429  5283 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.286312  5029 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.286612  4511 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.287979  5314 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.288861  4436 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.290035  5283 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.291018  5314 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.305126  5314 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.307268  5029 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.311985  4436 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.320785  4511 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.333560  4261 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.352795  5243 raft_consensus.cc:1064] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:18.356446  5283 raft_consensus.cc:1064] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:18.361430  5243 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.363323  5283 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.404408  5029 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.406322  5292 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.407181  4511 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.408749  5332 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.413108  4357 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:18.430872  5332 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.438738  5030 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.438980  4363 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.440405  5298 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.441799  5243 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.443845  4511 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.451426  5314 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.455181  4513 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:18.457598  5031 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:18.457789  5029 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.464002  5298 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:13:18.469440  5298 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.473259  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 632d1ea17544468d8db4dfec9893bc7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.493120  4264 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.499518  4260 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.505733  4366 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.516521  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 632d1ea17544468d8db4dfec9893bc7d with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:18.544847  5030 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.549013  4515 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.576025  5331 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:18.593371  4511 raft_consensus.cc:2955] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.741423  5345 tablet_replica.cc:333] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:18.883111  5340 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:18.885710  5031 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.037513  4436 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:19.043283  5353 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.060465  5345 raft_consensus.cc:2243] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.061652  5345 raft_consensus.cc:2272] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.073017  5345 ts_tablet_manager.cc:1916] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:13:19.097653  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 345061us
I20260709 12:13:19.106251  5345 ts_tablet_manager.cc:1929] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:19.143599  5345 log.cc:1199] T 632d1ea17544468d8db4dfec9893bc7d P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/632d1ea17544468d8db4dfec9893bc7d
I20260709 12:13:19.151916  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 632d1ea17544468d8db4dfec9893bc7d (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:19.170517  4264 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.223866  4441 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.282405  4514 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.344199  4437 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:19.352437  4358 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.353427  5029 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.354866  5352 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:19.356017  5341 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.368853  5352 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.372576  5031 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.380075  4358 raft_consensus.cc:2955] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.388437  4260 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.400192  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66db2395fb8d472bae50ea6bda5a63f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.402482  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 66db2395fb8d472bae50ea6bda5a63f8 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:19.416917  5361 tablet_replica.cc:333] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:19.418483  5361 raft_consensus.cc:2243] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.419500  5361 raft_consensus.cc:2272] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.425179  5361 ts_tablet_manager.cc:1916] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:19.447803  5361 ts_tablet_manager.cc:1929] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:19.448274  5361 log.cc:1199] T 66db2395fb8d472bae50ea6bda5a63f8 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/66db2395fb8d472bae50ea6bda5a63f8
I20260709 12:13:19.450383  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 66db2395fb8d472bae50ea6bda5a63f8 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:19.455039  4358 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:19.460434  5031 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:19.461961  5331 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.462577  4441 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:19.466576  5340 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:19.470242  5339 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.479528  5031 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.480309  4440 raft_consensus.cc:2955] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.515378  4260 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 4 to 5, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:19.524590  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd282266b4fc4ef98c399a7ea99210df with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.535457  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet cd282266b4fc4ef98c399a7ea99210df with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:19.536618  5361 tablet_replica.cc:333] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:19.537741  5361 raft_consensus.cc:2243] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.538574  5361 raft_consensus.cc:2272] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.546231  5361 ts_tablet_manager.cc:1916] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:19.564244  5361 ts_tablet_manager.cc:1929] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:13:19.564743  5361 log.cc:1199] T cd282266b4fc4ef98c399a7ea99210df P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/cd282266b4fc4ef98c399a7ea99210df
I20260709 12:13:19.566288  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet cd282266b4fc4ef98c399a7ea99210df (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
W20260709 12:13:19.968904  4536 debug-util.cc:398] Leaking SignalData structure 0x7b080017eee0 after lost signal to thread 3214
W20260709 12:13:19.970052  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800108ec0 after lost signal to thread 4298
W20260709 12:13:19.971338  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800321320 after lost signal to thread 4390
W20260709 12:13:19.972385  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800302740 after lost signal to thread 4465
W20260709 12:13:19.973721  4536 debug-util.cc:398] Leaking SignalData structure 0x7b08002065a0 after lost signal to thread 4539
W20260709 12:13:19.974805  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800318fc0 after lost signal to thread 5055
I20260709 12:13:20.624677  4514 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:20.638720  4479 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e80f7c2589340f0b76dfe7449339a9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.640301  4437 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.644313  4360 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.644158  5355 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.647104  5355 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.684559  5350 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.693400  4437 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.709107  4514 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:20.714432  4262 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.732807  4360 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:20.760509  4479 consensus_peers.cc:597] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6942a9e429240fcb7987e82e7a08f52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.774155  4437 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.778204  4359 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.782531  5367 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.786638  5367 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.805912  5350 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.809780  4359 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.813074  4437 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.832542  4260 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.834609  4437 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:20.845873  4511 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:20.847232  4405 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d34886e28324e3a9e84a6ecb6b1b615. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.848449  5368 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.854456  4359 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.856509  5372 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.890003  5369 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.902870  4362 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.911108  4359 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:20.924723  4511 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.929148  4262 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:20.939010  4330 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d85ac676e004b609f70d47ae2ac3c44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.944802  4437 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.946462  5331 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.958832  4511 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:20.963464  5331 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.974314  5362 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.976593  4437 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.985978  4514 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:20.996767  4260 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:21.063582  5384 ts_tablet_manager.cc:933] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:21.070289  5384 tablet_copy_client.cc:323] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:21.071944  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet 2e80f7c2589340f0b76dfe7449339a9d from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:21.072479  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet 2e80f7c2589340f0b76dfe7449339a9d from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-2e80f7c2589340f0b76dfe7449339a9d
I20260709 12:13:21.083841  4525 tablet_copy_source_session.cc:215] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.086813  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e80f7c2589340f0b76dfe7449339a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.100502  5384 tablet_copy_client.cc:806] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.101140  5384 tablet_copy_client.cc:670] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.106362  5384 tablet_copy_client.cc:538] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.121609  5384 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:21.151376  5384 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.152462  5384 tablet_bootstrap.cc:492] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:21.153437  5384 ts_tablet_manager.cc:1403] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.007s
I20260709 12:13:21.156813  5384 raft_consensus.cc:359] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.157828  5384 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:21.158655  5384 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:21.301312  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 45901.9us
I20260709 12:13:21.355242  5391 ts_tablet_manager.cc:933] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:21.363945  5391 tablet_copy_client.cc:323] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:21.385339  5390 ts_tablet_manager.cc:933] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:21.464666  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 64364.7us
W20260709 12:13:21.490404  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 58678.7us
I20260709 12:13:21.531392  5390 tablet_copy_client.cc:323] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:21.534564  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 5d34886e28324e3a9e84a6ecb6b1b615 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:21.535434  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 5d34886e28324e3a9e84a6ecb6b1b615 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-5d34886e28324e3a9e84a6ecb6b1b615
W20260709 12:13:21.570689  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53724.1us
I20260709 12:13:21.574599  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet c6942a9e429240fcb7987e82e7a08f52 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:21.575282  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet c6942a9e429240fcb7987e82e7a08f52 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-c6942a9e429240fcb7987e82e7a08f52
I20260709 12:13:21.585242  4525 tablet_copy_source_session.cc:215] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:21.600927  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 80427.6us
I20260709 12:13:21.631350  5391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6942a9e429240fcb7987e82e7a08f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.683127  5395 ts_tablet_manager.cc:933] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
W20260709 12:13:21.725791  5384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.162s	sys 0.227s
W20260709 12:13:21.726348  5384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.162s	sys 0.227s
I20260709 12:13:21.729292  5384 ts_tablet_manager.cc:1434] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.575s	user 0.169s	sys 0.228s
W20260709 12:13:21.729748  5384 ts_tablet_manager.cc:1467] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Tablet startup took 575ms
I20260709 12:13:21.742153  4451 tablet_copy_source_session.cc:215] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.745237  5395 tablet_copy_client.cc:323] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:21.747063  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 0d85ac676e004b609f70d47ae2ac3c44 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:21.747623  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 0d85ac676e004b609f70d47ae2ac3c44 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-0d85ac676e004b609f70d47ae2ac3c44
I20260709 12:13:21.749115  5390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34886e28324e3a9e84a6ecb6b1b615. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:21.730154  5384 ts_tablet_manager.cc:1469] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Trace:
0709 12:13:21.061715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.061841 (+   126us) service_pool.cc:224] Handling call
0709 12:13:21.063889 (+  2048us) ts_tablet_manager.cc:934] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
0709 12:13:21.085627 (+ 21738us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:21.094132 (+  8505us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:21.094214 (+    82us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:21.099277 (+  5063us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:21.099550 (+   273us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:21.099832 (+   282us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:21.099889 (+    57us) inbound_call.cc:177] Queueing success response
0709 12:13:21.117976 (+ 18087us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:13:21.153833 (+ 35857us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:13:21.154414 (+   581us) tablet_replica.cc:261] Starting instrumentation
0709 12:13:21.155063 (+   649us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":268,"raft.queue_time_us":501896,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":276,"tablet-copy.queue_time_us":1346,"tablet-download-pool.queue_time_us":155,"tablet-download-pool.run_cpu_time_us":1054,"tablet-download-pool.run_wall_time_us":4497,"thread_start_us":574046,"threads_started":3}
I20260709 12:13:21.767711  4376 tablet_copy_source_session.cc:215] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.773842  5395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d85ac676e004b609f70d47ae2ac3c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.805385  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-2e80f7c2589340f0b76dfe7449339a9d received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:21.805908  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-2e80f7c2589340f0b76dfe7449339a9d on tablet 2e80f7c2589340f0b76dfe7449339a9d with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:21.807082  5390 tablet_copy_client.cc:806] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.807745  5390 tablet_copy_client.cc:670] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.817633  5390 tablet_copy_client.cc:538] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.820184  5391 tablet_copy_client.cc:806] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.820950  5391 tablet_copy_client.cc:670] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.827212  5395 tablet_copy_client.cc:806] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.827956  5395 tablet_copy_client.cc:670] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.833372  5395 tablet_copy_client.cc:538] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.837860  5391 tablet_copy_client.cc:538] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.873368  5395 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:21.871447  5390 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:21.868712  5391 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:21.956995  5390 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.959640  5390 tablet_bootstrap.cc:492] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:21.960879  5390 ts_tablet_manager.cc:1403] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.090s	user 0.025s	sys 0.009s
I20260709 12:13:21.966917  5390 raft_consensus.cc:359] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.968133  5391 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.972492  5391 tablet_bootstrap.cc:492] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:21.973335  5391 ts_tablet_manager.cc:1403] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.105s	user 0.032s	sys 0.012s
I20260709 12:13:21.976641  5395 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.978024  5395 tablet_bootstrap.cc:492] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:21.978963  5395 ts_tablet_manager.cc:1403] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.106s	user 0.024s	sys 0.006s
I20260709 12:13:21.968315  5390 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:21.979707  5391 raft_consensus.cc:359] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.979928  5390 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.991181  5391 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:21.992395  5391 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.994199  5390 ts_tablet_manager.cc:1434] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:13:21.984712  5395 raft_consensus.cc:359] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.995205  5391 ts_tablet_manager.cc:1434] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:13:21.995437  5395 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:21.996398  5395 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:21.999394  5395 ts_tablet_manager.cc:1434] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:13:22.003206  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-5d34886e28324e3a9e84a6ecb6b1b615 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:22.003669  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-5d34886e28324e3a9e84a6ecb6b1b615 on tablet 5d34886e28324e3a9e84a6ecb6b1b615 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:22.004805  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-0d85ac676e004b609f70d47ae2ac3c44 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:22.004913  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c6942a9e429240fcb7987e82e7a08f52 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:22.005373  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-0d85ac676e004b609f70d47ae2ac3c44 on tablet 0d85ac676e004b609f70d47ae2ac3c44 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:22.005453  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-c6942a9e429240fcb7987e82e7a08f52 on tablet c6942a9e429240fcb7987e82e7a08f52 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:22.035835  5029 raft_consensus.cc:1217] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.040275  5030 raft_consensus.cc:1217] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.194000  5030 raft_consensus.cc:1217] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.346681  5030 raft_consensus.cc:1217] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.579998  5397 raft_consensus.cc:1064] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:22.589624  5397 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:22.601023  5331 raft_consensus.cc:1064] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:22.604668  5331 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:22.627167  4441 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.629043  5030 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.630561  5408 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.635326  5408 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.645838  4360 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.685531  5029 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.687287  5401 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.693132  5388 raft_consensus.cc:1064] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:22.696048  5388 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:22.723789  4437 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.728519  5331 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.740303  5408 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.747915  5029 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.761471  4440 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.761775  5402 raft_consensus.cc:1064] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:22.765282  5402 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:22.786132  4360 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.794947  5388 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.800734  5397 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.804380  4514 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.817216  5414 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.840663  5397 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.844096  5420 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:22.853783  5030 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.855785  4513 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.857172  5368 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:22.858354  5372 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.867319  4441 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:22.872975  4261 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.899590  4358 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.914124  5030 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:22.937757  5369 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.954710  5331 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.005203  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 66685.8us
I20260709 12:13:22.992591  4363 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.022645  4511 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.061828  4441 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.136253  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 44163.7us
I20260709 12:13:23.146404  5388 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.175084  5031 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.209102  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 135141us
I20260709 12:13:23.210222  5030 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.210090  5372 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.241608  5030 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.293632  4441 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.298532  4363 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.281677  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 137588us
I20260709 12:13:23.304055  4513 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.323287  4262 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.325052  4262 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.326530  4262 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.349520  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 46119us
I20260709 12:13:23.362465  4363 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:23.371289  4508 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:23.377980  5030 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.380297  5411 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.390558  5401 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.393353  5030 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.399549  5031 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.404026  4437 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.407788  5439 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.409845  5449 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.421847  5441 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.432221  5027 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.437558  4513 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:23.441387  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d85ac676e004b609f70d47ae2ac3c44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.441520  4508 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.444716  4437 raft_consensus.cc:2955] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.450878  4363 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.454447  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6942a9e429240fcb7987e82e7a08f52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.464721  4441 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:23.466949  4261 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.473040  5031 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.475078  5448 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:23.484107  5372 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.494400  5027 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.500563  4359 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.496222  5030 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.502921  4260 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.507128  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d34886e28324e3a9e84a6ecb6b1b615 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.502293  5441 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:13:23.520699  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d85ac676e004b609f70d47ae2ac3c44 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:23.529445  5409 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:23.535316  5404 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:23.538012  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 43838.9us
I20260709 12:13:23.545455  5031 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.563549  4363 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.568755  4260 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.570328  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet c6942a9e429240fcb7987e82e7a08f52 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:23.575879  5442 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:23.579668  5372 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.588898  4358 raft_consensus.cc:2955] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.594563  4359 raft_consensus.cc:2955] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.595928  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d34886e28324e3a9e84a6ecb6b1b615 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:23.599833  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e80f7c2589340f0b76dfe7449339a9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:23.608075  4513 raft_consensus.cc:2955] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:23.605526  4260 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.614250  5450 tablet_replica.cc:333] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:23.615813  5450 raft_consensus.cc:2243] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.617249  5450 raft_consensus.cc:2272] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.654500  5450 ts_tablet_manager.cc:1916] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.667415  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e80f7c2589340f0b76dfe7449339a9d with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
I20260709 12:13:23.674257  5452 tablet_replica.cc:333] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:23.690843  5451 tablet_replica.cc:333] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:23.692279  5451 raft_consensus.cc:2243] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.693627  5451 raft_consensus.cc:2272] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.701160  5451 ts_tablet_manager.cc:1916] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.714305  5450 ts_tablet_manager.cc:1929] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.714720  5452 raft_consensus.cc:2243] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.715670  5452 raft_consensus.cc:2272] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.719712  5452 ts_tablet_manager.cc:1916] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.719908  5451 ts_tablet_manager.cc:1929] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.720486  5451 log.cc:1199] T c6942a9e429240fcb7987e82e7a08f52 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/c6942a9e429240fcb7987e82e7a08f52
I20260709 12:13:23.722425  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet c6942a9e429240fcb7987e82e7a08f52 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:23.714802  5450 log.cc:1199] T 0d85ac676e004b609f70d47ae2ac3c44 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/0d85ac676e004b609f70d47ae2ac3c44
I20260709 12:13:23.724785  5450 tablet_replica.cc:333] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:23.725837  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 0d85ac676e004b609f70d47ae2ac3c44 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:23.725842  5450 raft_consensus.cc:2243] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.727303  5450 raft_consensus.cc:2272] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.731325  5450 ts_tablet_manager.cc:1916] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.741338  5452 ts_tablet_manager.cc:1929] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.741909  5452 log.cc:1199] T 5d34886e28324e3a9e84a6ecb6b1b615 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/5d34886e28324e3a9e84a6ecb6b1b615
I20260709 12:13:23.744445  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 5d34886e28324e3a9e84a6ecb6b1b615 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:23.750022  5450 ts_tablet_manager.cc:1929] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.750669  5450 log.cc:1199] T 2e80f7c2589340f0b76dfe7449339a9d P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/2e80f7c2589340f0b76dfe7449339a9d
I20260709 12:13:23.752655  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 2e80f7c2589340f0b76dfe7449339a9d (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:24.769275  5459 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:24.770320  4405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.010s	sys 0.001s
W20260709 12:13:24.770686  4405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.001s
I20260709 12:13:24.770061  5459 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.799896  5459 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.802830  5459 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:24.803432  5459 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.806631  5459 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:24.813472  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:24.832103  5462 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.833439  5462 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.840583  5462 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.841984  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:24.870702  5401 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.871354  5401 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.873423  5401 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.874325  5449 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:24.874866  5449 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.877306  5449 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:24.883149  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:24.888926  5433 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.889719  5433 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.901815  5459 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.904029  5433 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.904788  5433 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.905418  5433 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.929235  4407 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:24.902525  5459 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.932210  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:24.940871  5456 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.942703  5437 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:24.944980  5465 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:24.945717  5437 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.945863  5465 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.946372  5437 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.941519  5456 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.930400  5462 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.955655  4440 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:24.964053  5467 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.964612  5467 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.967289  5433 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.967839  5467 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.968868  5467 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:24.969416  5467 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:24.973076  5431 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:24.973860  5431 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.983389  5467 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:24.954689  5462 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:24.981736  5439 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:24.986418  5457 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:24.993448  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1063) took 1164 ms. Trace:
I20260709 12:13:25.000867  5448 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.007916  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.001350  5439 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.002348  5431 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.003013  5437 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:25.019557  5465 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.075116  5411 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.003907  4358 rpcz_store.cc:276] 0709 12:13:23.828845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.992888 (+1164043us) service_pool.cc:224] Handling call
0709 12:13:24.993141 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.993255 (+   114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.993270 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.993295 (+    25us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:24.993311 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.993343 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.993408 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:25.054260  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 72379.3us
I20260709 12:13:25.091964  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.098173  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:25.052146  4295 debug-util.cc:398] Leaking SignalData structure 0x7b080003de60 after lost signal to thread 3214
I20260709 12:13:25.101141  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.101599  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.075273  5401 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.105039  5401 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.102602  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.106938  5467 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.020161  5438 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.026448  5439 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.024111  5456 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.019923  5457 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.117763  5457 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.118863  5468 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.118453  5431 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.119517  5468 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.120534  5431 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.108137  5467 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.122803  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.123279  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.053045  5448 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.107239  5401 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.125183  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.081831  5411 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.107362  5433 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.126104  5469 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:25.135619  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.140970  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.143316  5461 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.149098  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:25.151389  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 44813us
I20260709 12:13:25.151640  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.129292  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.153683  5473 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.155139  5467 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.156299  5467 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.156431  5448 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.156822  5468 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.156883  5467 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.159556  5467 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.114616  5438 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.161783  5431 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.163411  5438 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:25.134452  5433 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.164167  4331 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.165946  5433 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.167963  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:25.151120  4295 debug-util.cc:398] Leaking SignalData structure 0x7b080008b800 after lost signal to thread 4298
I20260709 12:13:25.170583  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.171893  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.173418  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.175597  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.177888  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.180467  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.189287  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.154739  5469 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.177078  5473 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.193361  5469 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.173338  5468 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.149657  5461 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.206750  5411 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.208669  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:25.181375  5465 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.211295  4996 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.215378  5439 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.194585  5462 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.223417  4405 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.224022  5461 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.226768  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.220901  5469 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.235553  5465 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.280685  5465 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.221541  5439 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.317310  5469 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.318063  5469 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:25.320641  5469 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.321614  5453 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.324739  5473 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:25.347905  4295 debug-util.cc:398] Leaking SignalData structure 0x7b080026be00 after lost signal to thread 4390
W20260709 12:13:25.351496  4295 debug-util.cc:398] Leaking SignalData structure 0x7b0800338060 after lost signal to thread 4465
W20260709 12:13:25.354065  4295 debug-util.cc:398] Leaking SignalData structure 0x7b08002cbae0 after lost signal to thread 4539
W20260709 12:13:25.383548  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 165055us
I20260709 12:13:25.245683  4996 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.397991  5473 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.411309  5431 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.413465  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.388469  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.427929  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.432359  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.441434  4997 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.441936  5443 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:25.443197  5469 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.448468  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 223327us
I20260709 12:13:25.450166  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.451123  5441 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.442935  5443 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:25.455528  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 235696us
I20260709 12:13:25.446388  5431 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.472303  5441 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.457470  5473 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.484892  5431 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.489017  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.490914  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.490931  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.455169  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:25.494014  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.495100  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.502432  4997 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.504230  5473 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.508780  5443 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.514022  5441 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:25.499214  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46401.9us
I20260709 12:13:25.523166  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:25.528126  4295 debug-util.cc:398] Leaking SignalData structure 0x7b080032b940 after lost signal to thread 5055
I20260709 12:13:25.542418  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.546754  5439 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:25.551126  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:25.570223  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.573457  5459 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:25.574474  4365 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.575014  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.579248  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.581586  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.586560  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.587659  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.589751  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.590219  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.590771  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.593055  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.590308  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.572125  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.588338  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.601349  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:25.607317  4405 consensus_peers.cc:597] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 649a2c7d074941a39496be2ed5768f58. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.615846  4997 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.616892  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.619170  5461 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.621518  5459 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.610562  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 57814.5us
I20260709 12:13:25.625970  4997 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.634222  5459 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:25.634563  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 46541.5us
I20260709 12:13:25.644991  4407 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.637948  4406 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.651526  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.655737  5459 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.656896  5486 ts_tablet_manager.cc:933] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.657130  4997 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.659492  5459 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.663120  5448 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.664096  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.662223  5443 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.664916  4407 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.665419  5443 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:25.661697  4996 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.667444  5459 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.670866  5484 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.674285  5484 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.675136  4407 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.676157  5448 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.676891  4510 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.679816  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.690469  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.694937  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.695330  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.695830  4364 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:25.698026  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.707525  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.710232  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.707996  5486 tablet_copy_client.cc:323] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:25.715246  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.716305  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 649a2c7d074941a39496be2ed5768f58 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:25.716650  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.717029  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 649a2c7d074941a39496be2ed5768f58 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-649a2c7d074941a39496be2ed5768f58
I20260709 12:13:25.723269  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.724866  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.733646  4451 tablet_copy_source_session.cc:215] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:25.734954  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:25.738304  5448 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.742079  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:25.744130  4332 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.744911  5486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a2c7d074941a39496be2ed5768f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.745262  5461 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.753553  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.754613  5485 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.755689  4332 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.756655  5461 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.756181  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.757952  5485 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.758143  4332 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.759116  5461 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.761330  4332 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.762784  5461 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.764457  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.770959  5461 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:25.775591  4332 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.779429  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.780089  5461 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.781908  5481 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.775974  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:25.783679  5482 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.788391  4332 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.789335  5481 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.796800  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.798118  4407 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.798336  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.798944  5443 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.799943  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:25.810488  5368 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:25.816473  4996 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.817871  5459 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.819140  4996 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.820320  5459 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.821323  4996 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:25.822320  5473 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:25.827184  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:25.822851  4364 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:25.827957  5482 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:25.828405  5482 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:25.828773  5482 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.852849  4511 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:25.872253  5486 tablet_copy_client.cc:806] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.873080  5486 tablet_copy_client.cc:670] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:25.881438  5486 tablet_copy_client.cc:538] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.882220  4514 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:25.890707  5482 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:25.907474  5482 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:25.916381  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:25.915620  4260 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:25.919855  4479 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b524dfc86657460e8841456102df7e40. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.918944  4435 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.924304  5485 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.926467  5486 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:25.950798  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:25.952920  4362 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.966877  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:25.973650  5485 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:13:25.973182  5475 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:26.049443  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 48084.3us
W20260709 12:13:26.191345  5492 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.132s	user 0.004s	sys 0.000s
I20260709 12:13:26.243717  5486 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:26.250226  5486 tablet_bootstrap.cc:492] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:26.251490  5486 ts_tablet_manager.cc:1403] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.325s	user 0.028s	sys 0.022s
I20260709 12:13:26.305490  5486 raft_consensus.cc:359] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.333889  4514 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.342303  5503 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.322986  5486 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:26.345845  5486 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:26.357892  5402 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.368108  4365 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:26.381970  5495 raft_consensus.cc:3055] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.382438  5495 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:26.383337  5495 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.384554  5495 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.408083  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:26.420957  4435 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:26.420020  4441 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.436829  4361 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:13:26.441049  4330 consensus_peers.cc:597] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ace27fd51bc488ca513d42f77ae9744. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.441516  4436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:26.442130  4436 raft_consensus.cc:606] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:26.444978  4434 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.448248  4511 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.456624  5486 ts_tablet_manager.cc:1434] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.205s	user 0.020s	sys 0.010s
I20260709 12:13:26.454617  4262 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.459326  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-649a2c7d074941a39496be2ed5768f58 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:26.459864  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-649a2c7d074941a39496be2ed5768f58 on tablet 649a2c7d074941a39496be2ed5768f58 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:26.461750  5461 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.470038  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:26.471004  4438 raft_consensus.cc:606] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:26.472877  5505 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:26.475764  4436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:26.476709  4436 raft_consensus.cc:606] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:26.487994  5368 raft_consensus.cc:993] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.488541  5368 raft_consensus.cc:1081] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.503494  4362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:26.504276  4362 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.504747  4362 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.508795  5505 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.523864  4441 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.541317  4514 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:26.542763  4260 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.547575  4362 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.556355  4362 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:26.558128  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:26.558809  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:26.561569  4479 consensus_peers.cc:597] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 414c481bb7ad485898e5ed66d8a38344. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.569860  4435 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.574280  4436 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.574901  4510 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.575173  4436 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:26.577970  4362 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:26.580500  5486 ts_tablet_manager.cc:933] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:26.576205  4436 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.588806  4436 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.596032  5503 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.596997  5441 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.605691  4436 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.607226  4332 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:26.608206  5481 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.608690  5481 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:26.608481  4514 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.614065  5481 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.626384  4510 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.627903  5443 raft_consensus.cc:993] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.628219  4511 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:26.628399  5443 raft_consensus.cc:1081] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.631115  5486 tablet_copy_client.cc:323] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:26.633417  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet b524dfc86657460e8841456102df7e40 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:26.634092  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet b524dfc86657460e8841456102df7e40 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-b524dfc86657460e8841456102df7e40
I20260709 12:13:26.651489  4362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:26.652230  4362 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.652654  4362 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.684859  4362 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.686281  4525 tablet_copy_source_session.cc:215] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.687611  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:26.687845  4362 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:26.688251  4435 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.688629  4435 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:26.691485  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:26.692066  4514 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.691314  4435 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.695716  5025 raft_consensus.cc:1217] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:26.696954  5486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b524dfc86657460e8841456102df7e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:26.696624  5025 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.702427  4435 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.703118  5441 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.714715  4514 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.707383  4260 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.707013  4365 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.737576  4331 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:26.745441  5481 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.746151  5481 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:26.748097  5481 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.796972  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:26.797734  4514 raft_consensus.cc:606] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:26.805855  5372 raft_consensus.cc:993] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.806411  5372 raft_consensus.cc:1081] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.813122  4362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:26.813731  4362 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.814087  4362 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.814877  4441 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:26.820957  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:26.821641  4438 raft_consensus.cc:606] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:26.823509  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:26.825178  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.825625  4362 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.828027  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.828747  4435 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.841115  4260 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.842028  4362 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:26.843585  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:26.844189  4435 raft_consensus.cc:3055] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.844489  4435 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:26.845564  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:26.846274  4514 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.847290  4435 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.847710  5368 raft_consensus.cc:993] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.848243  5368 raft_consensus.cc:1081] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:26.859464  4365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:26.860389  4365 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.861088  4365 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.867563  4435 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.878224  4365 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:26.884485  5486 tablet_copy_client.cc:806] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:26.885188  5486 tablet_copy_client.cc:670] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:26.894273  4435 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.895857  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:26.896672  5461 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.897137  5461 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:26.898025  5461 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:26.904215  4261 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:26.905158  4514 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:26.931623  4365 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:26.931695  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:26.932621  4511 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.937677  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:26.938333  4435 raft_consensus.cc:3055] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.938642  4435 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:26.940078  4435 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:26.941540  4435 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.952548  4435 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:26.945804  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 70154.8us
I20260709 12:13:26.990617  5486 tablet_copy_client.cc:538] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:27.003082  5404 raft_consensus.cc:993] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:27.003643  5503 raft_consensus.cc:1081] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:26.957043  5519 ts_tablet_manager.cc:933] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:26.956548  4261 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.013056  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:13:27.013664  4438 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.014210  4438 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.970350  4511 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:27.022411  4331 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:27.025475  5505 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.025971  5505 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:27.026859  5505 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.036644  5486 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:27.042107  4438 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.047508  4262 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.053334  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:27.054042  4365 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.060705  4438 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:27.061527  4360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:27.061688  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:27.062106  4360 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:27.062199  4511 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.062507  4511 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:27.063011  5519 tablet_copy_client.cc:323] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:27.063288  4511 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.065107  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 8ace27fd51bc488ca513d42f77ae9744 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:27.065658  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 8ace27fd51bc488ca513d42f77ae9744 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-8ace27fd51bc488ca513d42f77ae9744
I20260709 12:13:27.064499  4511 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.074462  4512 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.076653  5461 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.077459  4365 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:27.075054  4511 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:27.078860  4406 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:27.079636  5443 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.080170  5443 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:27.081101  5443 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.083377  4376 tablet_copy_source_session.cc:215] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:27.086665  4365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:27.087846  4365 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:13:27.089259  4251 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 649a2c7d074941a39496be2ed5768f58 already in progress [suppressed 1 similar messages]
I20260709 12:13:27.088543  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ace27fd51bc488ca513d42f77ae9744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:27.114068  4365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:27.114652  4365 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:27.119539  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.127219  4438 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.131937  5372 raft_consensus.cc:993] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:27.132469  5372 raft_consensus.cc:1081] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:27.134459  5023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:13:27.135107  5023 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.135037  5505 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.135812  5023 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:27.138168  4312 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:13:27.143716  4312 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 649a2c7d074941a39496be2ed5768f58 already in progress
W20260709 12:13:27.144462  4312 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 649a2c7d074941a39496be2ed5768f58 already in progress
I20260709 12:13:27.156945  5023 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:27.189086  5023 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:27.195232  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:27.195714  5519 tablet_copy_client.cc:806] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:27.195943  4360 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.196310  5519 tablet_copy_client.cc:670] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:27.201201  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:27.201798  4441 raft_consensus.cc:3055] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.202078  4441 raft_consensus.cc:740] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:27.202837  4441 consensus_queue.cc:260] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:27.203790  4441 raft_consensus.cc:3060] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.218621  5529 ts_tablet_manager.cc:933] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:27.219528  4360 raft_consensus.cc:2468] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:27.221374  4997 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:27.222316  5507 raft_consensus.cc:2804] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.235086  5519 tablet_copy_client.cc:538] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:27.244171  5507 raft_consensus.cc:697] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:27.245319  5507 consensus_queue.cc:237] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:27.220227  4441 raft_consensus.cc:2468] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:27.261623  5529 tablet_copy_client.cc:323] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:27.264439  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet 414c481bb7ad485898e5ed66d8a38344 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:27.265005  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet 414c481bb7ad485898e5ed66d8a38344 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-414c481bb7ad485898e5ed66d8a38344
I20260709 12:13:27.266032  5519 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:27.278468  4261 catalog_manager.cc:5697] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.286717  4525 tablet_copy_source_session.cc:215] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:27.288288  5486 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.289304  5486 tablet_bootstrap.cc:492] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:27.291066  5529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414c481bb7ad485898e5ed66d8a38344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:27.293637  5486 ts_tablet_manager.cc:1403] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.257s	user 0.023s	sys 0.010s
I20260709 12:13:27.297781  4441 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.298818  4511 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.299613  5505 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.301038  5461 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.325291  4441 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.326776  5461 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.343799  5486 raft_consensus.cc:359] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.349812  5486 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:27.350739  5486 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.358947  5486 ts_tablet_manager.cc:1434] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.065s	user 0.002s	sys 0.005s
I20260709 12:13:27.364974  4512 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.366199  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-b524dfc86657460e8841456102df7e40 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:27.366703  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-b524dfc86657460e8841456102df7e40 on tablet b524dfc86657460e8841456102df7e40 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:27.369436  5481 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.380975  5519 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.382067  5519 tablet_bootstrap.cc:492] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:27.388265  5519 ts_tablet_manager.cc:1403] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.010s
I20260709 12:13:27.391125  5529 tablet_copy_client.cc:806] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:27.391799  5529 tablet_copy_client.cc:670] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:27.399293  5519 raft_consensus.cc:359] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.400298  5519 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:27.401057  5519 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.403527  5519 ts_tablet_manager.cc:1434] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:13:27.405707  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-8ace27fd51bc488ca513d42f77ae9744 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:27.406240  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-8ace27fd51bc488ca513d42f77ae9744 on tablet 8ace27fd51bc488ca513d42f77ae9744 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:27.414186  5529 tablet_copy_client.cc:538] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:27.463907  5529 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:27.507135  5529 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.508236  5529 tablet_bootstrap.cc:492] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:27.509034  5529 ts_tablet_manager.cc:1403] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.013s
I20260709 12:13:27.512730  5529 raft_consensus.cc:359] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.513749  5529 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:27.514500  5529 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.517693  5529 ts_tablet_manager.cc:1434] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.002s
I20260709 12:13:27.520694  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-414c481bb7ad485898e5ed66d8a38344 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:27.521171  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-414c481bb7ad485898e5ed66d8a38344 on tablet 414c481bb7ad485898e5ed66d8a38344 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:27.544972  4365 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.546802  5443 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.556221  5025 raft_consensus.cc:1217] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.558115  4438 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.564585  5441 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.565083  5441 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.567193  5541 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.568662  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:27.570313  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:27.570941  4435 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:27.586973  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:27.595162  5404 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:27.595592  5404 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.595922  5404 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.568965  5441 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:27.615024  4512 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.616801  5541 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.641803  4511 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.643738  5368 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:27.646175  4360 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.650447  5533 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.653388  4435 raft_consensus.cc:1275] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.655200  5533 consensus_queue.cc:1048] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.670181  5025 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Advancing to term 2
I20260709 12:13:27.677729  5404 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.678247  5025 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:27.679865  5541 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.689555  5481 raft_consensus.cc:1064] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:13:27.690114  5481 raft_consensus.cc:1068] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Unable to promote non-voter 133eea4ce99644f5adbd12c985fc95cb: Service unavailable: leader transfer in progress
I20260709 12:13:27.717267  5404 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:27.754069  5025 raft_consensus.cc:1217] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.768002  5025 raft_consensus.cc:1217] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.777702  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:27.778335  4435 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.781292  5481 raft_consensus.cc:993] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:27.782649  5481 raft_consensus.cc:1081] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:27.785450  4435 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:27.789613  4441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:27.790165  4441 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.790489  4441 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.791968  5540 raft_consensus.cc:1064] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:13:27.792395  5540 raft_consensus.cc:1068] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Unable to promote non-voter 133eea4ce99644f5adbd12c985fc95cb: Service unavailable: leader transfer in progress
I20260709 12:13:27.794951  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:27.797974  4441 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.801833  4435 raft_consensus.cc:1240] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:27.804831  5481 consensus_queue.cc:1059] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.805778  5481 raft_consensus.cc:3055] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:27.806249  5481 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:27.800716  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:27.807330  5481 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.808840  5404 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.809218  5481 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.809306  5404 raft_consensus.cc:697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:27.816123  4441 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:27.817058  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:27.817723  4512 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.822803  5404 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.825383  4512 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:27.827659  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:27.826603  4406 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:27.833907  5443 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:27.834383  5443 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:27.835228  5443 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:27.841676  4360 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:27.847597  4262 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.874544  5540 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:27.873769  4260 catalog_manager.cc:5697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.875881  5540 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:27.877902  5540 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:27.879601  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:27.888029  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:27.888818  4441 raft_consensus.cc:2368] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:27.890008  4332 leader_election.cc:400] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:27.890303  4332 leader_election.cc:403] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:27.891279  5540 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:27.905910  5540 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:28.047713  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.160856  5404 raft_consensus.cc:1064] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:28.167425  5404 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.177359  4441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:28.178001  4441 raft_consensus.cc:606] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:28.181133  4441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:28.181762  4441 raft_consensus.cc:606] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:28.189549  4441 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.190088  5025 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.191475  5404 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.192862  4365 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.194036  5503 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.204074  5404 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.230863  4365 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.243851  4514 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:28.245733  5368 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.250138  5481 raft_consensus.cc:1064] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:28.251458  5503 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.259819  5475 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.261425  5481 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.267998  4441 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.302567  5025 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.305851  5464 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.319100  4434 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.321242  5464 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.334522  5441 raft_consensus.cc:1064] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:28.337160  5441 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.348915  5025 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.355433  4262 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.367556  5481 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.369246  5475 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.374776  5030 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Advancing to term 3
I20260709 12:13:28.379801  5023 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.382860  4438 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.384092  4441 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:28.384656  5475 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.386720  5404 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:28.388455  5030 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:28.390918  5443 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.395049  4434 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.433342  4364 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:13:28.525607  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 55854.4us
I20260709 12:13:28.563745  5404 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:28.579564  5571 log.cc:927] Time spent T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:13:28.588337  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 78618.8us
I20260709 12:13:28.595556  4511 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.597286  4365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:28.597903  4365 raft_consensus.cc:606] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:28.610844  5443 raft_consensus.cc:993] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
W20260709 12:13:28.618841  5575 log.cc:927] Time spent T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:13:28.647305  5368 raft_consensus.cc:1081] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
W20260709 12:13:28.680378  5574 log.cc:927] Time spent T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
W20260709 12:13:28.734150  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 136558us
I20260709 12:13:28.737285  4362 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:28.763450  5372 raft_consensus.cc:1064] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:28.770565  5372 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:28.772137  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 182932us
W20260709 12:13:28.777297  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 194306us
I20260709 12:13:28.785099  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:13:28.785737  5030 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.786087  5030 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.777688  4512 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.792016  5025 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.801050  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:28.801762  4514 raft_consensus.cc:606] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:28.782364  4360 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:28.838642  5030 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.912640  5030 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:28.935598  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 61006.7us
I20260709 12:13:28.931722  5028 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:28.944139  5587 raft_consensus.cc:993] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:28.944654  5587 raft_consensus.cc:1081] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:28.945993  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:28.946674  4359 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.947767  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:28.948418  4432 raft_consensus.cc:3055] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.948740  4432 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:28.949304  4514 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:28.949520  4432 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:28.949918  5592 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:28.961155  5600 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.965617  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:28.966256  4438 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.966642  4438 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.970633  5496 raft_consensus.cc:993] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:28.973242  5496 raft_consensus.cc:1081] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:28.976845  4359 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:28.977504  4361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:28.978114  4361 raft_consensus.cc:606] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:28.980792  4361 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:28.973927  4261 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.950913  4432 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.984633  5597 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:28.992633  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.997121  4364 raft_consensus.cc:1240] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.000151  4360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:29.046469  4360 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.046897  4360 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.048071  5588 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:29.049300  4432 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:29.000442  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:29.050835  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:29.050084  4511 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.051774  5533 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.024295  5441 raft_consensus.cc:993] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:29.052590  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:29.053452  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.053565  5441 raft_consensus.cc:1081] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:29.030171  5026 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:29.000680  4438 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.056443  4438 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:29.061993  4360 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.064170  4360 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:29.066227  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:29.066865  4514 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.063889  5570 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.074319  5588 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.076799  4510 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:29.085651  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 51816us
I20260709 12:13:29.088606  5475 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.087734  5026 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.096436  4514 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:29.097904  4406 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:29.100677  5591 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.101200  5591 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:29.109402  5503 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.114387  5023 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.118130  5598 raft_consensus.cc:993] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:29.118923  5589 raft_consensus.cc:1081] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
W20260709 12:13:29.124588  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 147049us
I20260709 12:13:29.130445  5028 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.134141  5533 raft_consensus.cc:697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:29.135347  5533 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:29.142234  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:29.142971  4512 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.102380  5591 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.154335  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:29.155085  4432 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.155475  4432 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:29.156664  4432 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.157979  4432 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.163707  4262 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 2 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.172571  4360 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.171909  4441 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.185672  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:29.186365  4360 raft_consensus.cc:3055] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.186697  4360 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:29.186971  4434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:29.186905  4435 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:29.188349  4434 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.188761  4434 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.188577  4360 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.189813  4360 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.194857  5030 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:29.196899  4438 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.200347  4360 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:29.200838  4512 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:29.201344  5588 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:29.210194  5597 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.214164  4262 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.214824  5030 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.223234  4434 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:29.230739  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 43675.5us
I20260709 12:13:29.234055  4363 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:29.235128  4365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:13:29.235795  4365 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.236223  4365 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.237702  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 649a2c7d074941a39496be2ed5768f58 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:29.239755  4362 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.243781  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:29.244524  4515 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.253989  4515 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:29.267848  4406 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:29.270345  5443 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.270908  5443 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:29.272109  5443 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.273182  4434 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:29.299825  4513 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:29.418390  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 110015us
I20260709 12:13:29.532832  5441 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.537566  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b524dfc86657460e8841456102df7e40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:29.545516  4331 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:29.546007  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:29.546589  4357 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.546866  4357 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:29.547578  4357 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.548593  4357 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.550208  5598 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.550731  5598 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:29.551735  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.551599  5598 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.270345  4432 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:29.561450  4361 raft_consensus.cc:2955] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.629244  4357 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:29.719796  4365 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.721918  4365 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:29.733139  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:29.733842  4510 raft_consensus.cc:3055] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.734196  4510 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:29.735020  4510 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.736568  4510 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.744481  4510 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:29.761207  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:29.761848  4438 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.763502  5596 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:29.806970  4438 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:29.815429  4332 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:29.821450  4363 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.823357  5481 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.823918  5481 raft_consensus.cc:697] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:29.825286  5481 consensus_queue.cc:237] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:29.842639  4262 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 3 to 4, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.847998  4262 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.865461  4363 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.868680  5607 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:29.872802  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 309061us
I20260709 12:13:29.883121  4438 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.884341  4432 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:29.890695  5607 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.899242  5597 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:29.899837  5597 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:29.910892  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:29.912075  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.903458  5597 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:29.931602  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:29.962091  4511 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.973222  4361 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:29.975675  4511 raft_consensus.cc:2955] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:29.971778  4405 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:29.991080  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:29.993181  5496 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:29.984371  5594 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:30.022604  5622 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:30.164106  4509 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.171947  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet b524dfc86657460e8841456102df7e40 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46914
W20260709 12:13:30.175980  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 77901.4us
I20260709 12:13:30.171811  5588 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.183795  4513 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.187870  4261 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 5 to 6, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.192620  4261 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.196946  4364 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.197041  4260 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.225497  4514 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:30.199151  5481 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:13:30.264142  5642 tablet_replica.cc:333] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:13:30.268186  5642 raft_consensus.cc:2243] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.270574  5642 raft_consensus.cc:2272] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.273638  5642 ts_tablet_manager.cc:1916] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.286770  4435 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:30.299607  5026 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:30.306666  4434 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.324390  5640 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.295619  5588 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:13:30.294792  5567 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:13:30.339027  5475 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:30.366679  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 649a2c7d074941a39496be2ed5768f58 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:30.397574  4441 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.419341  4508 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.404996  5617 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.434716  5648 tablet_replica.cc:333] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:30.435942  5648 raft_consensus.cc:2243] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.439543  5629 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.466430  5640 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:30.468858  4263 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.471815  5026 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.504446  5648 pending_rounds.cc:70] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Trying to abort 1 pending ops.
I20260709 12:13:30.537637  4361 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:30.520440  5642 ts_tablet_manager.cc:1929] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:30.547094  5642 log.cc:1199] T b524dfc86657460e8841456102df7e40 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/b524dfc86657460e8841456102df7e40
I20260709 12:13:30.586699  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet b524dfc86657460e8841456102df7e40 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:30.597853  4262 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.523600  5648 pending_rounds.cc:77] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Aborting op as it isn't in flight: id { term: 3 index: 5 } timestamp: 7305622359118635008 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "649a2c7d074941a39496be2ed5768f58" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } } new_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } } }
I20260709 12:13:30.604460  4260 catalog_manager.cc:5697] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.615571  5026 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:30.617142  5617 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:30.608173  5648 raft_consensus.cc:2917] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted
I20260709 12:13:30.628062  5648 raft_consensus.cc:2889] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:30.628129  4432 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:30.629197  5648 raft_consensus.cc:2272] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.632045  5648 ts_tablet_manager.cc:1916] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.638554  5481 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:30.640568  4462 debug-util.cc:398] Leaking SignalData structure 0x7b08000a59c0 after lost signal to thread 3214
W20260709 12:13:30.641621  4462 debug-util.cc:398] Leaking SignalData structure 0x7b080016b0a0 after lost signal to thread 4298
W20260709 12:13:30.642830  4462 debug-util.cc:398] Leaking SignalData structure 0x7b080003ffa0 after lost signal to thread 4390
W20260709 12:13:30.644383  4462 debug-util.cc:398] Leaking SignalData structure 0x7b0800352fc0 after lost signal to thread 4465
W20260709 12:13:30.648200  4462 debug-util.cc:398] Leaking SignalData structure 0x7b08003176e0 after lost signal to thread 4539
W20260709 12:13:30.649394  4462 debug-util.cc:398] Leaking SignalData structure 0x7b080035ad00 after lost signal to thread 5055
W20260709 12:13:30.649943  4462 debug-util.cc:398] Leaking SignalData structure 0x7b080035aea0 after lost signal to thread 5551
W20260709 12:13:30.650271  4462 debug-util.cc:398] Leaking SignalData structure 0x7b080035af00 after lost signal to thread 5565
W20260709 12:13:30.672096  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 141127us
I20260709 12:13:30.672195  5616 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.683189  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 414c481bb7ad485898e5ed66d8a38344 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:30.684343  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.687276  4432 raft_consensus.cc:2955] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.689340  5026 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.735518  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ace27fd51bc488ca513d42f77ae9744 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:30.742635  5616 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:30.743378  5616 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:30.745829  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 414c481bb7ad485898e5ed66d8a38344 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:30.733453  4261 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.747125  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:30.752981  5616 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:30.756721  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:30.758714  4330 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:30.764365  5598 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:30.777845  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:30.781455  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ace27fd51bc488ca513d42f77ae9744 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36570
I20260709 12:13:30.811856  4432 raft_consensus.cc:2955] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:30.845434  5659 tablet_replica.cc:333] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:13:30.851312  4358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:30.851992  4358 raft_consensus.cc:606] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:30.853914  5659 raft_consensus.cc:2243] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.854822  5659 raft_consensus.cc:2272] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.864586  5648 ts_tablet_manager.cc:1929] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:13:30.865141  5648 log.cc:1199] T 649a2c7d074941a39496be2ed5768f58 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/649a2c7d074941a39496be2ed5768f58
I20260709 12:13:30.868142  5648 tablet_replica.cc:333] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:13:30.868782  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:30.869205  5648 raft_consensus.cc:2243] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:30.869592  4432 raft_consensus.cc:606] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:30.870291  5648 raft_consensus.cc:2272] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:30.873111  4434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:30.873936  4434 raft_consensus.cc:606] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:30.874728  5648 ts_tablet_manager.cc:1916] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.877035  4508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:30.877741  4508 raft_consensus.cc:606] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:30.883230  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 649a2c7d074941a39496be2ed5768f58 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:30.889449  4358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:30.890208  4358 raft_consensus.cc:606] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:30.893990  5648 ts_tablet_manager.cc:1929] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:30.894544  5648 log.cc:1199] T 414c481bb7ad485898e5ed66d8a38344 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/414c481bb7ad485898e5ed66d8a38344
I20260709 12:13:30.896142  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:30.896898  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 414c481bb7ad485898e5ed66d8a38344 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:30.897735  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.898475  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.917029  5659 ts_tablet_manager.cc:1916] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:30.945381  5597 raft_consensus.cc:993] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:30.945978  5591 raft_consensus.cc:1081] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:30.953006  5026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:13:30.953644  5026 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.954021  5026 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.962411  5026 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:30.981128  5659 ts_tablet_manager.cc:1929] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:30.985910  5659 log.cc:1199] T 8ace27fd51bc488ca513d42f77ae9744 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/8ace27fd51bc488ca513d42f77ae9744
I20260709 12:13:30.988097  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 8ace27fd51bc488ca513d42f77ae9744 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:13:30.988498  5026 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:30.989235  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:30.989706  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:30.989974  4432 raft_consensus.cc:3055] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.990289  4366 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.990417  4432 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:30.991672  4432 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:30.992588  5617 raft_consensus.cc:993] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:30.993109  5617 raft_consensus.cc:1081] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:30.993396  4432 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.994999  5026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:13:30.995645  5026 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.996059  5026 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.997354  4366 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:30.998513  4997 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:30.999370  5632 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.005152  5632 raft_consensus.cc:697] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:31.003858  4432 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:31.006753  5632 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.025804  5026 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.034345  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:31.034966  4366 raft_consensus.cc:3055] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.035635  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:31.043649  4508 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.070958  5653 raft_consensus.cc:993] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:31.071597  5655 raft_consensus.cc:1081] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:31.074571  5025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:31.075302  5025 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.075479  4508 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:31.075784  5025 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.076306  4510 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:31.036123  5026 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:31.039918  4262 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.043123  4366 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:31.080528  4366 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.081516  5616 consensus_queue.cc:1059] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.086339  4366 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.106302  5025 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.113034  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:31.102727  4366 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:31.123930  5632 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.124514  5632 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:31.124651  5025 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:31.125602  5632 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.127362  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:31.128106  4432 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.145438  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:31.146193  4508 raft_consensus.cc:3055] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.146535  4508 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:31.147446  4508 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.149766  4508 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.157976  4508 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:31.157888  4262 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.159356  4996 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:31.162336  5632 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.169107  5632 raft_consensus.cc:697] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:31.163048  4432 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:31.175779  5597 raft_consensus.cc:993] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:31.176431  5597 raft_consensus.cc:1081] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:31.176358  5632 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:31.210865  4366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:31.211604  4366 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.212059  4366 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.229974  5617 raft_consensus.cc:993] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:31.231348  5481 raft_consensus.cc:1081] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:31.237741  4434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:31.238590  4434 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.239145  4434 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:31.259763  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 67238.8us
I20260709 12:13:31.270730  4262 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.325352  4366 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.334522  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:31.335305  4432 raft_consensus.cc:3055] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.335706  4432 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:31.336591  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:31.337292  4512 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.336699  4432 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.340183  4432 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.380112  4366 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:31.334699  4434 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.383769  4434 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:31.386884  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:31.387526  4508 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.391366  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:31.392071  4366 raft_consensus.cc:3055] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.392402  4366 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:31.393181  4366 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.396535  4432 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:31.397976  4332 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:31.398907  5640 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.399426  5640 raft_consensus.cc:697] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:31.400385  5640 consensus_queue.cc:237] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.401897  4366 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.406145  4508 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:31.408187  4406 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:31.408986  5588 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.409485  5588 raft_consensus.cc:697] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:31.410413  5588 consensus_queue.cc:237] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:31.406973  4512 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:31.416944  4366 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:31.424986  4262 catalog_manager.cc:5697] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.468509  4262 catalog_manager.cc:5697] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.512804  4432 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.514734  5660 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.548983  4512 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.549535  4366 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.552477  5664 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:31.552760  4366 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.555287  5660 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.576398  5664 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:31.689297  4434 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.691922  5674 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:31.693210  4512 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.700625  5674 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:31.853981  4363 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.880407  4513 raft_consensus.cc:1275] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:31.883006  5598 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:31.900417  5588 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:31.953605  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.037124  4438 raft_consensus.cc:1275] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.055517  4508 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.048640  5681 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:13:32.083272  5597 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:32.257306  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:32.257910  4438 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:32.265651  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:32.266252  4512 raft_consensus.cc:606] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:32.272719  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:32.273324  4512 raft_consensus.cc:606] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:32.295953  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:32.296749  4512 raft_consensus.cc:606] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:32.311249  5685 raft_consensus.cc:993] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:32.311764  5685 raft_consensus.cc:1081] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:32.315836  4363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:32.316438  4363 raft_consensus.cc:606] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:32.322837  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:32.324594  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.325670  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.330385  4363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:32.331075  4363 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.331419  4363 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.339702  4363 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:32.371692  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:32.372328  4438 raft_consensus.cc:3055] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.372640  4438 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:32.373380  4438 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:32.368824  4363 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:32.374426  4438 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.357381  5679 raft_consensus.cc:993] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.380004  5679 raft_consensus.cc:1081] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.367548  4361 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:32.383517  5025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:13:32.384068  5025 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.384413  5025 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.388897  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:32.389534  4508 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.408146  4438 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:32.410588  4332 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:32.414141  5616 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.414659  5616 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:32.416448  5616 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:32.433722  5655 raft_consensus.cc:993] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.434702  5629 raft_consensus.cc:1081] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.437230  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:32.437795  5030 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.438187  5030 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.442274  4508 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:32.445427  5025 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.453646  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:32.454250  4363 raft_consensus.cc:3055] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:32.454584  4363 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:32.466082  4261 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.461899  4363 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.470966  4363 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.487840  5629 raft_consensus.cc:993] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.488358  5629 raft_consensus.cc:1081] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:32.491158  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:13:32.491514  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:32.491765  5028 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.492162  5028 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.492362  4438 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:32.494694  5025 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:32.508469  5030 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.513788  5030 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:32.514407  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:32.515079  4434 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.516265  5028 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.519588  4363 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:32.521338  5028 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:32.522679  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:32.523360  4508 raft_consensus.cc:3055] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.523617  4508 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:32.523478  4997 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:32.524622  4508 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.526633  4508 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.525781  5676 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:32.527469  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:32.528952  4512 raft_consensus.cc:3055] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.529253  4512 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:32.526685  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:32.533562  4363 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.533701  4438 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:32.534258  4512 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.541074  4508 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:32.552700  4512 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.553692  4363 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:32.557068  4997 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:32.558071  5632 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.558597  5632 raft_consensus.cc:697] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:32.559639  5632 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.564845  4434 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:32.569657  4997 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:32.570058  4512 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:32.583003  4432 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:32.583959  4330 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c0ed95ce6be4de980a07c4834b46498. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.586001  5681 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.586833  4512 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:32.604460  5679 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:32.661777  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 51024us
I20260709 12:13:32.662304  5698 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.668035  5698 raft_consensus.cc:697] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:32.671479  5698 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:32.679680  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 110096us
I20260709 12:13:32.681478  5681 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:32.690128  4438 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:32.710886  5676 raft_consensus.cc:697] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:32.767570  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 86227.7us
I20260709 12:13:32.734519  5676 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:32.863668  4513 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:32.852006  4261 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:32.920746  4262 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:32.938827  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 263925us
I20260709 12:13:32.947901  4438 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.955318  4261 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.961061  4261 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.939713  4513 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:32.969183  5717 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.997957  5703 raft_consensus.cc:993] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:32.998643  5703 raft_consensus.cc:1081] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
W20260709 12:13:33.006721  4479 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f841988974fd4cd9a66ea124b9b9b284. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.030076  4364 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.035954  4509 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.033491  5676 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:13:33.054972  5617 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:33.063030  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:13:33.063680  4432 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.064095  4432 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.064869  4441 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.075356  4432 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:33.084488  4509 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.088984  4432 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:33.089988  5585 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:33.093988  5676 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:33.095853  4363 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.098488  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:33.099145  4361 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.104867  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:33.105556  4512 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.105883  4512 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:33.106600  4361 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:33.106642  4512 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:33.109659  4407 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:33.114071  4512 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.125360  4512 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:33.143486  5685 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.170454  4512 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.143289  5585 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:33.175012  5697 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:33.179347  5685 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:33.190267  5685 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:33.231429  5703 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.235896  4441 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.258375  4438 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.259902  5676 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:33.311345  4366 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.328615  4364 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.334318  5728 ts_tablet_manager.cc:933] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:33.336010  4262 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 2, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.348812  4438 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:33.353971  5713 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:33.356446  4330 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 011d2125e98642bfaa9d1a5c58747e7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.362603  4513 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:33.365767  5617 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.367882  5681 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.369891  4261 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.377214  4513 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.378926  4366 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:33.380316  5676 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:33.369290  4432 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.399580  4438 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:33.400055  5728 tablet_copy_client.cc:323] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:33.402628  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 1c0ed95ce6be4de980a07c4834b46498 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:33.403393  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 1c0ed95ce6be4de980a07c4834b46498 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-1c0ed95ce6be4de980a07c4834b46498
I20260709 12:13:33.414538  5676 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:13:33.420879  4260 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.432338  4364 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.441992  4376 tablet_copy_source_session.cc:215] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:33.452255  5728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c0ed95ce6be4de980a07c4834b46498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:33.461530  4513 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:13:33.461937  4330 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8f3e66082564439be8a3b4a0292e958. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.465454  5679 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.468731  5735 ts_tablet_manager.cc:933] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:33.480605  4432 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:33.481386  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.487963  5708 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:33.523495  5713 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.529614  4508 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.553572  5735 tablet_copy_client.cc:323] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:13:33.558470  5728 tablet_copy_client.cc:806] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:33.571266  4364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:33.571880  4364 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:33.576129  4364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:33.576728  4364 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:33.569186  5728 tablet_copy_client.cc:670] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:33.578258  4251 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 011d2125e98642bfaa9d1a5c58747e7e already in progress
I20260709 12:13:33.583511  5728 tablet_copy_client.cc:538] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:33.582952  4263 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.587980  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet f841988974fd4cd9a66ea124b9b9b284 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:13:33.588604  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet f841988974fd4cd9a66ea124b9b9b284 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-f841988974fd4cd9a66ea124b9b9b284
I20260709 12:13:33.617661  4432 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:13:33.624457  4525 tablet_copy_source_session.cc:215] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:33.627897  5735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841988974fd4cd9a66ea124b9b9b284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:33.650544  4366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53160
I20260709 12:13:33.652706  4508 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.654052  5728 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:33.654572  5597 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.657788  4366 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:13:33.658562  4364 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.662473  5685 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:33.662958  4312 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:13:33.663441  4312 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 011d2125e98642bfaa9d1a5c58747e7e already in progress
W20260709 12:13:33.663750  4312 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 011d2125e98642bfaa9d1a5c58747e7e already in progress
I20260709 12:13:33.674393  4513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113336c186624ff989dd5bad91201a95"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:33.675076  4513 raft_consensus.cc:606] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:33.684773  4366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:33.685477  4366 raft_consensus.cc:606] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:33.691195  4513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b524dfc86657460e8841456102df7e40"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:33.691877  4513 raft_consensus.cc:606] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:33.696213  4513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:33.696913  4513 raft_consensus.cc:606] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:33.701532  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:33.702092  4432 raft_consensus.cc:606] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:33.705471  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:33.707911  5735 tablet_copy_client.cc:806] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:33.711575  5735 tablet_copy_client.cc:670] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:33.713585  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.719556  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.723382  5735 tablet_copy_client.cc:538] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:33.739869  5717 raft_consensus.cc:993] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:33.740420  5717 raft_consensus.cc:1081] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:33.746482  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:33.747061  4432 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.747424  4432 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.759516  4432 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:33.767182  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:33.767794  5030 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.774418  5030 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:33.776132  4405 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:33.776865  5685 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.777362  5685 raft_consensus.cc:697] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:33.767233  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:33.779680  4364 raft_consensus.cc:3055] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.778649  5685 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:33.788446  4364 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:33.790841  4364 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:33.794191  4364 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.781014  5713 raft_consensus.cc:993] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:33.795688  5713 raft_consensus.cc:1081] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:33.791666  4432 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:33.805384  5735 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:13:33.805578  4441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:13:33.806187  4441 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.806599  4441 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.824268  4441 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.826241  4364 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:33.829360  5728 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:33.830286  5728 tablet_bootstrap.cc:492] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:33.830788  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:33.831462  4366 raft_consensus.cc:3055] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.833817  4366 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:33.834111  4441 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:33.834573  4366 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.841202  4366 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.836966  4261 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.836743  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:33.844679  4513 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.830958  5728 ts_tablet_manager.cc:1403] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.006s
I20260709 12:13:33.855104  4366 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:33.856343  4407 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:33.857376  5685 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.858096  5685 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:33.856333  5728 raft_consensus.cc:359] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.860014  5728 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:33.859061  5685 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.899171  5728 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:33.902398  5728 ts_tablet_manager.cc:1434] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:13:33.915961  4513 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:33.927779  4261 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.947532  5685 raft_consensus.cc:993] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:33.948827  5597 raft_consensus.cc:1081] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:33.949285  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-1c0ed95ce6be4de980a07c4834b46498 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:33.949741  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-1c0ed95ce6be4de980a07c4834b46498 on tablet 1c0ed95ce6be4de980a07c4834b46498 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:33.950742  4366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:33.951361  4366 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.951709  4366 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.964313  4366 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:33.967244  4366 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:33.967939  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:33.968742  4441 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.969105  4441 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:33.970086  4441 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:33.971514  4441 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.973491  5747 ts_tablet_manager.cc:933] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:13:33.977535  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:33.978243  4513 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.986074  4513 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:33.989696  4331 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:33.995836  5681 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:34.026201  5681 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:34.027230  5681 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.060928  4441 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:34.064109  5585 raft_consensus.cc:993] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:34.064553  5585 raft_consensus.cc:1081] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:34.035255  5747 tablet_copy_client.cc:323] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:13:34.076646  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet a8f3e66082564439be8a3b4a0292e958 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:13:34.077251  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet a8f3e66082564439be8a3b4a0292e958 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-a8f3e66082564439be8a3b4a0292e958
I20260709 12:13:34.091454  5735 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.092454  5735 tablet_bootstrap.cc:492] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:34.093147  5735 ts_tablet_manager.cc:1403] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.288s	user 0.029s	sys 0.044s
I20260709 12:13:34.096243  4376 tablet_copy_source_session.cc:215] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:34.105302  5735 raft_consensus.cc:359] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:34.108134  5735 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:34.108959  5735 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:34.109514  5747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3e66082564439be8a3b4a0292e958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:34.127733  5735 ts_tablet_manager.cc:1434] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:13:34.135357  4366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b524dfc86657460e8841456102df7e40"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:13:34.137025  4366 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.137790  4366 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.117940  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.168885  4366 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:34.174764  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:34.175722  4513 raft_consensus.cc:3055] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.176167  4513 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:34.177129  4513 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:34.178377  4513 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.180136  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:34.180945  5030 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.194550  5030 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:34.195101  4366 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:34.199611  4330 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:34.200682  5717 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.201248  5717 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:34.202234  5717 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:34.197042  4513 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:34.213518  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 47542us
I20260709 12:13:34.234009  5753 raft_consensus.cc:993] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:34.234553  5755 raft_consensus.cc:1081] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:34.247437  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:13:34.248013  4438 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.248356  4438 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.250818  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-f841988974fd4cd9a66ea124b9b9b284 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:13:34.252149  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-f841988974fd4cd9a66ea124b9b9b284 on tablet f841988974fd4cd9a66ea124b9b9b284 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:34.260051  5709 raft_consensus.cc:993] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:34.267019  4438 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.265271  4261 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.271915  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:34.272578  4363 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.276597  5030 raft_consensus.cc:1217] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:34.277885  5747 tablet_copy_client.cc:806] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:34.278535  5747 tablet_copy_client.cc:670] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:34.282706  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:34.283373  4508 raft_consensus.cc:3055] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.283708  4508 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:34.284492  4508 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.285763  4438 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:34.263361  5709 raft_consensus.cc:1081] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:34.288851  4363 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:34.290730  4508 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.290325  4407 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:34.299798  5747 tablet_copy_client.cc:538] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:34.307302  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113336c186624ff989dd5bad91201a95"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:13:34.307648  5030 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:34.311604  4405 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 011d2125e98642bfaa9d1a5c58747e7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.302796  5588 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.316987  5588 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:34.318071  5588 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.319526  4508 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:34.320055  4438 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.322162  4438 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.325896  5597 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:13:34.347235  4438 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.362107  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:34.362316  4438 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:34.362771  4363 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.362826  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:34.363444  4508 raft_consensus.cc:3055] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.363739  4508 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:34.371301  4508 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:34.372730  4508 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.376832  4363 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:34.381579  4407 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:34.382624  5757 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.383515  5757 raft_consensus.cc:697] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:34.380929  4508 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:34.407335  4513 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:34.417196  5685 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:34.819682  5758 log.cc:927] Time spent T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 12:13:35.175928  4481 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.032s
W20260709 12:13:35.176424  4481 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.032s
W20260709 12:13:35.181092  4478 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.006s	sys 0.029s
W20260709 12:13:35.184562  4478 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.029s
I20260709 12:13:35.187858  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:35.212769  4480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.006s	sys 0.032s
W20260709 12:13:35.214318  4480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.006s	sys 0.032s
I20260709 12:13:35.115733  5757 consensus_queue.cc:237] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.245270  5747 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
W20260709 12:13:35.212034  5759 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.833s	user 0.001s	sys 0.000s
W20260709 12:13:35.252897  4479 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.044s	sys 0.087s
W20260709 12:13:35.253548  4479 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.045s	sys 0.087s
W20260709 12:13:35.288504  4997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.028s	sys 0.014s
W20260709 12:13:35.289026  4997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.028s	sys 0.014s
W20260709 12:13:35.351688  4995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.021s
W20260709 12:13:35.352124  4995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.000s	sys 0.021s
W20260709 12:13:35.359731  4404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.017s	sys 0.016s
W20260709 12:13:35.361059  4404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.017s	sys 0.016s
W20260709 12:13:35.364202  4407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.003s	sys 0.021s
W20260709 12:13:35.364745  4407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.003s	sys 0.021s
W20260709 12:13:35.410908  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 52132us
W20260709 12:13:35.477034  4996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.019s	sys 0.020s
I20260709 12:13:35.454087  5654 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:35.482547  4996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.019s	sys 0.020s
I20260709 12:13:35.461333  5762 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:35.518743  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 68630.5us
W20260709 12:13:35.500715  4994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.034s	sys 0.106s
I20260709 12:13:35.508845  5654 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.554889  5777 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.563311  5777 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.563851  5768 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.564603  5654 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.564391  5768 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.565187  5654 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.565802  5777 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.565657  5654 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.535356  5760 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.566553  5768 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.566738  5760 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.568415  5776 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:35.568964  5706 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.569339  5760 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.513640  5762 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.569587  5706 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.570999  4513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1386) took 1003 ms. Trace:
I20260709 12:13:35.572002  5762 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.572273  5770 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:35.572788  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.573112  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.571498  4513 rpcz_store.cc:276] 0709 12:13:34.567335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.567556 (+   221us) service_pool.cc:224] Handling call
0709 12:13:34.568015 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:35.055969 (+487954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.056018 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.056639 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.482064 (+425425us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:35.482138 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.482234 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.570718 (+ 88484us) raft_consensus.cc:1685] finished
0709 12:13:35.570741 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.570875 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":590765,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":912397,"threads_started":2,"wal-append.queue_time_us":463990}
I20260709 12:13:35.574402  5686 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.572818  5770 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.575022  5686 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.575868  5654 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.576336  5706 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.574270  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.577693  5686 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.584331  5654 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.585762  5585 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:35.562383  4994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.035s	sys 0.106s
I20260709 12:13:35.577877  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.569010  5776 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.588349  4435 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:35.587997  5585 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.588846  5654 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.589985  5776 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.591068  5585 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.592243  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.593865  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.594352  5654 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.594195  5767 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.599471  5776 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.600571  5776 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.603331  5776 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.604841  5706 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.605270  5654 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.605510  5706 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.605800  5654 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:35.578822  5770 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.607656  5706 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.609598  5654 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.609761  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.600459  5767 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.611737  5654 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.612474  5654 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.613870  5767 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:35.615962  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 60013.8us
I20260709 12:13:35.620100  5654 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.660185  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.670899  5748 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.675064  5686 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.675853  5585 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.676321  5686 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:35.677034  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:35.679646  5709 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:35.676775  5585 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.684791  5784 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:35.685726  5686 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.685626  5784 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.688300  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.690461  5784 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.694458  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.695824  4436 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:35.672444  5748 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.702440  5774 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.680658  5709 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.708087  5763 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.709443  4997 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:35.704146  5774 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.686262  5025 raft_consensus.cc:1217] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:35.712880  5755 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.713094  5760 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.713591  5654 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.716478  5748 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.717078  5757 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.726878  5654 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.729470  5757 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.717617  5784 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:35.719866  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.724121  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:35.732632  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:35.724833  5760 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.724164  5780 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:35.734175  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:35.726605  5783 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.709357  5763 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.735462  5780 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.727421  5709 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.740744  5763 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.733937  5755 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.744786  5748 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.745853  5780 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.734910  5784 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.753865  5784 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.754558  5785 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.756228  5774 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.757802  5654 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.752552  5585 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.766206  5748 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.763550  5785 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.745987  5783 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.773375  5755 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.785426  5767 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.786379  5767 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.789155  5767 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.794754  5760 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.798010  5757 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.802901  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:35.804003  5585 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.804980  5585 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.808986  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:35.809887  4509 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:35.780025  5785 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.815347  5783 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.816262  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:35.817284  4513 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:35.810950  5774 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.811159  5748 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.829553  5585 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:35.837340  5783 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.840384  5783 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.835071  5706 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.834636  5757 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.845723  5706 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.855530  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:35.863508  5779 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.864462  5779 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.868691  5755 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:35.870514  5783 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.871110  5774 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:35.876076  5763 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.891098  5757 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:35.893954  5757 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.910934  5654 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:35.911504  5763 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.912068  5654 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.917138  5763 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.917359  5654 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.928164  5774 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:35.951344  5755 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.953799  5755 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:35.908079  5585 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:35.986342  5585 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:35.998533  5797 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:35.999472  5797 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:36.010450  5794 ts_tablet_manager.cc:933] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:36.013972  5784 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:36.024235  5798 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:36.029858  5779 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:36.035600  5797 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:36.025365  5798 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:36.044518  5791 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:36.040607  5784 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:36.103303  5798 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:36.103605  5802 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:36.338490  5795 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:36.045430  5791 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:36.104774  5794 tablet_copy_client.cc:323] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:13:36.302362  5797 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:36.317378  5796 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:36.967358  5796 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:36.046142  4261 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.979429  5797 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:36.982470  5795 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:36.983672  4364 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:36.985328  5795 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:36.986215  5797 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:36.986215  5803 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:36.987756  5796 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:36.987541  5803 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:36.979969  5805 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:36.996264  4387 debug-util.cc:398] Leaking SignalData structure 0x7b0800119e20 after lost signal to thread 3214
I20260709 12:13:36.997323  5805 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:36.981957  5802 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:37.014839  4332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.039s	sys 0.049s
W20260709 12:13:37.017571  4332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.039s	sys 0.049s
I20260709 12:13:37.026155  5800 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.026978  5800 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.032128  5800 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.026196  5796 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:37.033730  5805 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.034214  5796 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.035048  5803 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.036938  5806 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.037104  5796 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.037807  5796 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.039280  5795 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.039918  5795 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.041280  5797 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.042181  5797 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:37.043170  5798 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:37.033432  5791 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.043871  5798 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.044449  5791 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.037655  5806 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.045162  5805 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:37.045289  5791 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.045889  5805 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.038528  5796 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.047230  5800 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.048030  5800 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.053576  5685 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:37.054608  5685 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.056972  5685 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.063720  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.064869  5026 raft_consensus.cc:2393] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:13:37.065047  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.068732  5026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44156 (request call id 170) took 1270 ms. Trace:
I20260709 12:13:37.069446  5026 rpcz_store.cc:276] 0709 12:13:35.798510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.802435 (+  3925us) service_pool.cc:224] Handling call
0709 12:13:37.066848 (+1264413us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400561b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:37.068616 (+  1768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2899568000}
I20260709 12:13:37.074738  5802 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.075161  5795 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.057078  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.058059  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.062557  4358 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.081663  5808 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.082372  5803 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:37.082536  5804 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.083227  5804 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.083958  5802 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.084689  5802 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.085508  5804 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.086015  5804 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:37.083096  5803 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.081575  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.087414  4365 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:37.088836  5803 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.086608  5804 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.094333  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.090901  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.092713  4358 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.089447  5808 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.096758  5795 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.097489  5795 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.098708  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.100860  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.086833  5802 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.101948  5803 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.102648  5803 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.104763  5803 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.105695  5808 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.107125  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.107578  5804 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.107764  4364 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:37.101205  5795 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.111778  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.112429  4365 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:37.117969  5685 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:37.119043  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.119985  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.121141  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.121431  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.121873  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.122201  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.122954  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.123258  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.123437  5685 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:37.124185  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.122642  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.124825  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.125327  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.126523  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.126717  5685 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:37.131655  5685 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.132467  5685 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.140375  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.361348  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.471869  5685 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.554693  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.570387  5814 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:37.571465  5814 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.588798  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.589937  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.599475  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:37.556720  5685 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:37.849112  5685 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:37.852257  5685 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:37.859261  5685 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.022845  5685 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:37.861760  5814 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.084090  5685 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.084807  5685 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.085477  5685 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:38.119871  5812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.008s
I20260709 12:13:38.129594  5797 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.130296  4508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1389) took 2589 ms. Trace:
I20260709 12:13:38.132974  4508 rpcz_store.cc:276] 0709 12:13:35.540966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.541136 (+   170us) service_pool.cc:224] Handling call
0709 12:13:35.541529 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.567270 (+ 25741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.567303 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.567345 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:35.567378 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.129819 (+2562441us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54001e1254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:38.129889 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.130109 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58720128}
W20260709 12:13:38.132301  4480 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.006s
W20260709 12:13:38.134963  4480 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.005s	sys 0.006s
I20260709 12:13:38.135756  5709 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.136415  5709 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.138834  5709 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:38.132295  5812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.008s
I20260709 12:13:38.141726  5747 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:38.142943  5747 tablet_bootstrap.cc:492] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:38.144865  5819 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.145162  5747 ts_tablet_manager.cc:1403] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 2.927s	user 0.041s	sys 0.042s
I20260709 12:13:38.145342  5814 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.146464  5685 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.146431  5814 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.148520  5805 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.156924  4511 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.155488  4508 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:38.157500  5747 raft_consensus.cc:359] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:38.158048  5814 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.158422  5747 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:38.158641  5814 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.159128  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 252) took 2503 ms. Trace:
I20260709 12:13:38.155383  5818 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.170367  5686 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.170856  5818 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.171468  5686 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.173466  5818 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.159309  5747 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:38.159912  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.145823  5812 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.168078  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.174672  4509 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:38.176699  5755 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.174017  5818 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.188217  5818 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:38.186122  5755 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.194314  5818 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.194412  5755 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.187112  5814 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.196923  5814 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.226298  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.189870  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.228840  4507 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:38.229907  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.231149  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.231280  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.145640  5819 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.194886  5818 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.232203  5823 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.232402  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.232772  5818 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.233649  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.197743  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.185695  5812 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.241489  5819 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.242489  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.244067  5812 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.244884  5819 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.245378  5819 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.245865  5819 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.246366  5585 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:38.199283  4997 connection.cc:256] RPC call timeout handler was delayed by -1.1975109370000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 12:13:38.174857  5686 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.200088  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.202701  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:38.247740  4997 connection.cc:256] RPC call timeout handler was delayed by -1.0220109370000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 12:13:38.203404  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.206051  5747 ts_tablet_manager.cc:1434] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
W20260709 12:13:38.201864  5028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.231s	user 0.029s	sys 0.017s
I20260709 12:13:38.161602  5817 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.251374  5817 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:38.252763  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1379) took 2110 ms. Trace:
I20260709 12:13:38.253142  4363 rpcz_store.cc:276] 0709 12:13:36.142218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.885862 (+743644us) service_pool.cc:224] Handling call
0709 12:13:36.967425 (+ 81563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.980267 (+ 12842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:36.980310 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:36.980369 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:36.980407 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.252323 (+1271916us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b54000f6754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:38.252369 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.252505 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19276160}
I20260709 12:13:38.254101  5817 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.217257  4366 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.254751  5757 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.255420  4366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1380) took 1362 ms. Trace:
I20260709 12:13:38.255800  4366 rpcz_store.cc:276] 0709 12:13:36.892750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.959716 (+ 66966us) service_pool.cc:224] Handling call
0709 12:13:38.214285 (+1254569us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b5800002d98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:38.214526 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.255155 (+ 40629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.255366 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265984}
I20260709 12:13:38.256474  4506 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:38.256582  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.220909  5770 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.257262  4432 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:38.257637  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.257477  5770 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.258920  5686 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.259567  5686 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.222132  5026 raft_consensus.cc:1240] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.223713  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.223951  5025 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:38.226261  5031 raft_consensus.cc:1217] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:38.232829  5823 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.198683  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.267740  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.268123  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.268602  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.268823  5029 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:38.269464  4441 raft_consensus.cc:2468] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:38.270925  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:38.271617  4438 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.274277  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.274977  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 011d2125e98642bfaa9d1a5c58747e7e from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:13:38.275736  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 011d2125e98642bfaa9d1a5c58747e7e from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-011d2125e98642bfaa9d1a5c58747e7e
I20260709 12:13:38.229916  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.283595  4507 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:38.169991  4261 rpcz_store.cc:276] 0709 12:13:35.655913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.766300 (+110387us) service_pool.cc:224] Handling call
0709 12:13:38.159043 (+2392743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:37.070676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:37.071386 (+   710us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:37.071433 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:13:37.071466 (+    33us) tablet.cc:662] Decoding operations
0709 12:13:37.072009 (+   543us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:37.072116 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:37.072151 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:37.072504 (+   353us) tablet.cc:701] Row locks acquired
0709 12:13:37.072591 (+    87us) write_op.cc:260] PREPARE: finished
0709 12:13:37.072785 (+   194us) write_op.cc:270] Start()
0709 12:13:37.072921 (+   136us) write_op.cc:276] Timestamp: P: 1783599217072716 usec, L: 0
0709 12:13:37.072958 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:13:37.073869 (+   911us) log.cc:844] Serialized 538 byte log entry
0709 12:13:37.110616 (+ 36747us) op_driver.cc:464] REPLICATION: finished
0709 12:13:37.572586 (+461970us) write_op.cc:301] APPLY: starting
0709 12:13:37.572728 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:37.572908 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:37.573117 (+   209us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:37.573510 (+   393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:37.573869 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:37.573960 (+    91us) write_op.cc:312] APPLY: finished
0709 12:13:37.576073 (+  2113us) log.cc:844] Serialized 23 byte log entry
0709 12:13:37.577529 (+  1456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.577643 (+   114us) write_op.cc:454] Released schema lock
0709 12:13:37.577734 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:37.753514 (+175780us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.799362 (+ 45848us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5893,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":442844,"apply.run_cpu_time_us":2947,"apply.run_wall_time_us":77287,"num_ops":1,"prepare.queue_time_us":85698,"prepare.run_cpu_time_us":7703,"prepare.run_wall_time_us":31181,"raft.queue_time_us":9107,"raft.run_cpu_time_us":3037,"raft.run_wall_time_us":17820,"replication_time_us":37471,"thread_start_us":75882,"threads_started":4,"wal-append.queue_time_us":25104}]]}
I20260709 12:13:38.235539  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.285126  4508 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:38.237059  5818 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.237805  5825 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.249308  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:38.249565  5028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.295s	user 0.032s	sys 0.018s
I20260709 12:13:38.262043  5821 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.250603  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.287285  5825 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.287657  5821 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.288031  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.288254  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.250294  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.289466  4510 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:38.255437  5757 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.295435  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:38.297019  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.301237  5686 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.303501  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.315582  5757 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.316926  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.317189  5806 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:38.318053  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08001201e0 after lost signal to thread 4298
I20260709 12:13:38.317411  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.318305  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.279935  5770 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.319199  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.320037  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.320192  5821 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.320999  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.321619  4997 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:38.321678  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.323798  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:38.325876  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccba0 after lost signal to thread 4390
I20260709 12:13:38.326705  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.331928  4434 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:38.326870  5825 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.334327  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.340633  5806 consensus_queue.cc:1059] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:38.341969  5805 raft_consensus.cc:3055] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.342370  5805 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:38.343328  5028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44156 (request call id 171) took 2514 ms. Trace:
I20260709 12:13:38.343802  5805 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.344666  4330 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:38.345674  5797 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:38.342260  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.347647  4438 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:38.346771  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.350390  5826 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.346751  5822 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.351059  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.351662  4441 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:38.351472  5822 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.345275  5805 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.362147  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.381166  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.355273  4436 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
W20260709 12:13:38.354912  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.407439  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.408191  4511 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:38.362907  5800 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:38.412904  4996 connection.cc:256] RPC call timeout handler was delayed by -1.0743552070000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 12:13:38.413072  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.416461  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.349478  5806 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:38.420044  4481 connection.cc:256] RPC call timeout handler was delayed by -1.3469718070000454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:13:38.420620  4481 connection.cc:256] RPC call timeout handler was delayed by -1.3361718070000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:13:38.421013  4481 connection.cc:256] RPC call timeout handler was delayed by -1.3349957060001998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:13:38.421334  4481 connection.cc:256] RPC call timeout handler was delayed by -1.1360461920000944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:13:38.421720  4481 connection.cc:256] RPC call timeout handler was delayed by -1.0829461920002359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 12:13:38.422098  4481 connection.cc:256] RPC call timeout handler was delayed by -1.0409843250001813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:13:38.422467  4481 connection.cc:256] RPC call timeout handler was delayed by -1.0409843250001813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 12:13:38.423802  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.423905  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.425064  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.425185  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.425637  4358 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:38.350908  5826 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.424746  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.426594  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.364346  5823 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.391086  5796 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.407716  5818 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.365480  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.371830  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:38.366712  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 45237.8us
I20260709 12:13:38.438071  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.439857  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.438426  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.426012  5761 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.436496  4451 tablet_copy_source_session.cc:215] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:38.470212  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.471791  5798 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.476447  5706 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.424437  5806 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:38.478075  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 131625us
I20260709 12:13:38.430229  5826 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.527335  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 48616.6us
I20260709 12:13:38.506635  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.492683  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.516510  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.530066  5800 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.533587  5800 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.535758  5800 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.487658  5761 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.532058  4997 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:38.548383  5820 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.548916  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.551847  5791 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.343842  5028 rpcz_store.cc:276] 0709 12:13:35.828704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.831917 (+  3213us) service_pool.cc:224] Handling call
0709 12:13:35.839819 (+  7902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.840285 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:35.885463 (+ 45178us) log.cc:844] Serialized 14 byte log entry
0709 12:13:38.335943 (+2450480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.342890 (+  6947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:38.342961 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.343075 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.343234 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46465,"prepare.queue_time_us":46644,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":60994,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":25247,"thread_start_us":2388911,"threads_started":2,"wal-append.queue_time_us":118939,"wal-append.run_cpu_time_us":1602,"wal-append.run_wall_time_us":1001615}
I20260709 12:13:38.513477  5819 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.557211  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.486502  4506 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:38.557690  4512 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:38.584196  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 160892us
I20260709 12:13:38.529520  5806 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.585206  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.585812  4365 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:38.585914  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.586297  5761 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:38.587569  4405 connection.cc:256] RPC call timeout handler was delayed by -1.1916614240001309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 12:13:38.493131  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.558297  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.591239  4434 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:38.442113  5818 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.593601  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.595574  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:38.595772  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 79404.6us
I20260709 12:13:38.584707  4357 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:38.595027  4513 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.599437  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.600412  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:38.590773  4996 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.721s (SENT) [suppressed 1 similar messages]
I20260709 12:13:38.603459  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.598006  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.612982  5031 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:38.591912  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.597802  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.597739  5800 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.601449  5796 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.591885  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.598001  5791 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.618923  4481 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:38.620857  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 62659.9us
I20260709 12:13:38.617951  5798 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:38.615871  5706 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.625072  5026 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:38.628631  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.626580  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.629477  5022 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:38.626371  5815 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.628250  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.630425  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.626513  5597 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.631630  4438 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:38.626580  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.625614  4405 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:38.635545  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.629601  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.615909  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.592746  5820 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.642647  5820 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.643119  5597 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:38.643939  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb4a0 after lost signal to thread 4465
I20260709 12:13:38.629663  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.648967  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:38.649338  4387 debug-util.cc:398] Leaking SignalData structure 0x7b0800133d40 after lost signal to thread 4466
I20260709 12:13:38.619482  4510 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
W20260709 12:13:38.650449  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08003283c0 after lost signal to thread 4539
W20260709 12:13:38.650853  4387 debug-util.cc:398] Leaking SignalData structure 0x7b0800349b00 after lost signal to thread 4540
I20260709 12:13:38.643944  5757 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.651979  5757 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.652384  5757 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.653244  5819 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.653981  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.654635  4364 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:38.628180  5800 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.605091  4441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:38.656579  4441 raft_consensus.cc:606] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.657330  5800 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.638962  5796 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.645788  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.671109  5796 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.672029  5796 raft_consensus.cc:1064] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:38.646206  5686 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.626961  5791 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.678324  5791 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.678966  5588 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.679399  5588 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.679777  5588 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.683254  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:38.683871  4514 raft_consensus.cc:606] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:38.684800  5806 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.661947  5751 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.638736  5829 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.686391  5829 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.686812  5829 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.687796  5757 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:38.689612  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08003613e0 after lost signal to thread 5055
I20260709 12:13:38.689862  5757 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:38.689949  4387 debug-util.cc:398] Leaking SignalData structure 0x7b08001057e0 after lost signal to thread 5056
W20260709 12:13:38.690670  4387 debug-util.cc:398] Leaking SignalData structure 0x7b0800140040 after lost signal to thread 5693
W20260709 12:13:38.690974  4387 debug-util.cc:398] Leaking SignalData structure 0x7b080036c3c0 after lost signal to thread 5719
W20260709 12:13:38.698959  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 87967us
I20260709 12:13:38.702204  4481 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.703596  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.664726  5818 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:38.667439  4407 connection.cc:256] RPC call timeout handler was delayed by -1.4670485090000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 12:13:38.626313  5831 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:13:38.668841  5597 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.668987  4405 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:13:38.713224  4407 connection.cc:256] RPC call timeout handler was delayed by -1.4238518310000927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 12:13:38.713596  4407 connection.cc:256] RPC call timeout handler was delayed by -1.331731032000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:13:38.713654  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 44758.3us
W20260709 12:13:38.713934  4407 connection.cc:256] RPC call timeout handler was delayed by -1.2802591970000776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 12:13:38.676071  5686 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:38.715762  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 112624us
W20260709 12:13:38.714370  4407 connection.cc:256] RPC call timeout handler was delayed by -1.1501474130000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 12:13:38.717676  4407 connection.cc:256] RPC call timeout handler was delayed by -1.1205518310000571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 12:13:38.717988  4407 connection.cc:256] RPC call timeout handler was delayed by -1.0533162609999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 12:13:38.718806  5822 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:38.704564  4361 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
W20260709 12:13:38.711994  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 87399.6us
I20260709 12:13:38.702409  5806 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.726605  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.725554  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
W20260709 12:13:38.727214  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 125793us
I20260709 12:13:38.716641  5820 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.732017  4997 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.727325  4512 raft_consensus.cc:606] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:38.762279  5816 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.779879  5686 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.782552  5825 raft_consensus.cc:2804] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.779258  5757 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:13:38.734294  5820 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:38.733052  5818 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.782598  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:38.792219  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 68561.3us
W20260709 12:13:38.796183  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 185923us
I20260709 12:13:38.779379  5826 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.789261  5820 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.728619  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:38.781517  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 52499.3us
I20260709 12:13:38.787113  5825 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.804430  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:38.779170  5588 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.805877  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.805119  4997 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.808801  5794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011d2125e98642bfaa9d1a5c58747e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:38.810583  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.811950  5031 raft_consensus.cc:1240] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.812816  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.805418  5825 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.813452  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 129628us
I20260709 12:13:38.816424  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.816469  5588 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.817994  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.826131  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.829216  5818 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.829461  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.832346  5831 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.833042  5831 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.820087  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:38.842268  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:38.842506  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a8f3e66082564439be8a3b4a0292e958 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:13:38.842756  5831 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.842593  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.842970  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.820274  5821 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.838302  5797 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.849592  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-a8f3e66082564439be8a3b4a0292e958 on tablet a8f3e66082564439be8a3b4a0292e958 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:38.828290  5798 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.853454  5796 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.860004  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:38.860706  4361 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:38.860970  5797 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.861395  5791 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.861974  5791 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.863163  5797 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.863929  5791 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.865779  4331 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:38.867660  4331 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.868119  5805 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.868533  5805 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.857950  5597 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.868988  5805 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.869585  4331 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.871255  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.872593  5806 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.873010  5806 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.873375  5806 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.873332  5798 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.869077  5597 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:38.875379  5597 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.881711  5835 raft_consensus.cc:1064] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:38.871731  5831 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.883126  5831 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.883061  4406 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.883783  5831 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.884888  5757 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.885313  5757 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.885736  5757 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.885480  5829 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.887324  5025 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:13:38.888247  5826 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.889986  5029 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.881316  5805 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:38.890686  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.894724  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:38.894821  4331 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.902937  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:38.905162  5805 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:38.905853  5800 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.906286  5800 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.906641  5800 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.899438  4479 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.906895  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:38.908810  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:38.910840  5821 raft_consensus.cc:697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:38.916141  4331 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:38.917939  4331 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:38.918766  4997 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:38.919998  5751 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.920789  5816 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.920398  5821 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.922385  5798 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:38.914876  5805 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.923280  5805 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:38.923808  5805 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.920445  5839 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.924480  5839 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.924902  5839 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.936718  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 79521.7us
I20260709 12:13:38.893338  5835 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.942533  5817 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:38.943691  5817 raft_consensus.cc:3055] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.944033  5817 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:38.920617  5751 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.949874  4366 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.951645  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:38.938855  5823 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.955868  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.961014  4512 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:38.956386  5798 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:38.962261  5798 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.962599  5798 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:38.926021  5834 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.963447  5798 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.964622  5798 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.956554  5685 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.908803  5831 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:38.978351  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.968418  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.979969  4508 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:38.975634  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.977501  5825 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:38.952069  5751 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.981976  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.980948  4514 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:38.989617  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 204466us
I20260709 12:13:38.995081  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:38.979676  4515 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:38.999233  5588 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.940693  5816 consensus_queue.cc:1059] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:13:38.966572  5823 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:38.979336  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.004558  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.012342  4481 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:39.011642  4331 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.011906  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.016487  4511 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:39.017563  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.018235  4360 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:39.019141  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.019667  4360 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:39.020383  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.020982  4358 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:39.022536  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.029351  4366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b524dfc86657460e8841456102df7e40"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:13:39.029599  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.029990  4366 raft_consensus.cc:606] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:39.030277  4360 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:39.030431  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.031059  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.031136  4514 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:39.032234  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.032721  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.033844  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.033896  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.034539  4358 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:39.040786  5800 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.035986  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.013373  5823 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.044673  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.045447  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.056543  4508 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.047449  5806 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.037472  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.060547  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.050604  5819 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.988389  5820 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.019680  5831 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.052917  5031 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:39.060405  4506 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:39.062811  5791 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.076732  5820 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:39.086947  5825 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:39.087219  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:39.037539  5817 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.073448  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.071039  5791 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.111485  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.137410  5791 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:39.142997  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 61545.4us
I20260709 12:13:39.144443  4407 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:39.146257  5685 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.141022  4506 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:39.148038  5806 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.149689  5829 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.152870  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:39.146706  4407 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.153489  4441 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.163122  5597 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.159721  5836 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.171312  4441 raft_consensus.cc:2468] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:39.172595  4997 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:39.154695  5817 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.179668  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.173015  5597 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.189646  5825 raft_consensus.cc:2804] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.191776  5825 raft_consensus.cc:697] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:39.192682  5825 consensus_queue.cc:237] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.189585  5806 raft_consensus.cc:993] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
W20260709 12:13:39.214372  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 202807us
I20260709 12:13:39.216019  4357 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.216243  4331 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.222245  5031 raft_consensus.cc:1240] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.227252  5818 consensus_queue.cc:1059] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:39.225220  5805 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.228904  5766 raft_consensus.cc:1064] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:39.233090  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.237562  4357 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:39.232187  5706 consensus_queue.cc:1059] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:39.239655  5805 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:39.241472  5815 raft_consensus.cc:3055] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.259418  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.259654  4406 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:39.258330  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.254465  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:39.262501  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:39.262898  4364 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:39.261029  5815 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:39.255165  5797 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.263842  5797 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.264215  5797 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.265138  4512 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
W20260709 12:13:39.252259  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 171117us
I20260709 12:13:39.251276  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:39.244175  4331 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.270148  5685 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.222463  5823 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.272331  4361 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.264294  5815 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.273841  4331 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.244339  5848 raft_consensus.cc:1081] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:13:39.242728  5839 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.283208  4331 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.255375  5834 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:13:39.284106  5805 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.284556  5805 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.275429  5800 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.285053  5805 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.287463  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.288878  4331 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.289115  4407 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:39.290012  5588 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.290478  5588 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:39.290921  5588 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.287827  5844 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.294121  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
W20260709 12:13:39.295220  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 64234.9us
I20260709 12:13:39.295766  4331 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.296865  4331 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.296909  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:39.299904  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.303318  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:39.228919  5791 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.276706  5835 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.306710  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.320665  5838 raft_consensus.cc:3055] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.301246  5800 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.304780  5819 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.307824  5816 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:39.344563  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 55521.6us
I20260709 12:13:39.346261  4407 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.335433  5761 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:39.354594  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 51386.8us
I20260709 12:13:39.325771  5835 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.356230  4407 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.342036  5800 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.336017  5815 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.341322  5838 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:39.309706  5853 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.356343  4481 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
W20260709 12:13:39.358217  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 80888.8us
I20260709 12:13:39.345480  5816 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.352100  5846 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.366389  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.367722  5849 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.367383  5842 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.372968  5588 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.368386  4481 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:39.360921  5686 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.383008  5836 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.358237  5757 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.273008  5766 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.376120  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.379832  4439 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.381646  5805 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.382920  5796 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.375255  5853 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.361974  5800 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.361254  5835 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.386197  4441 raft_consensus.cc:1240] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.367939  5816 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.401175  4406 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:39.385497  5757 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.385802  5846 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.410075  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.430940  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.432081  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:39.355695  5685 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:39.410756  5796 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.412209  4440 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:39.411803  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 115003us
I20260709 12:13:39.413956  5856 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.414544  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.418560  5853 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.419535  4508 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:39.399034  5588 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.375666  5823 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:39.453657  4997 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:39.368243  5820 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:39.458349  5855 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.464272  5031 raft_consensus.cc:1240] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.463202  5828 consensus_queue.cc:1059] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:13:39.410045  5751 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.469875  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.455644  5818 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.432185  5846 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.455883  5761 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.457370  5796 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.500056  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.500315  5025 raft_consensus.cc:1240] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.467871  5856 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.501760  4513 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.471668  5849 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.474013  5822 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.503950  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.468060  5841 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.480566  5818 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:39.517647  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 85659.7us
I20260709 12:13:39.506110  5597 raft_consensus.cc:993] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:39.508466  5838 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:39.509280  5798 consensus_meta.cc:287] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.544s	user 0.004s	sys 0.013s
I20260709 12:13:39.476969  5791 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.482241  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.482702  5761 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.521059  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:39.512694  5856 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.547724  5588 raft_consensus.cc:1081] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:39.548939  4439 raft_consensus.cc:1240] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.522289  5818 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.524760  5819 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.549304  5761 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.548206  5822 raft_consensus.cc:697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:39.583657  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:39.588403  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.572485  5819 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:39.571894  5838 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:39.595804  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.600571  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:39.601253  4357 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.569460  5685 consensus_queue.cc:1059] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:13:39.607782  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.613440  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.596874  5819 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.599255  5805 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.631029  4437 raft_consensus.cc:1240] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:39.634747  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.638793  4357 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:39.635535  5751 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:39.647573  5870 raft_consensus.cc:993] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:39.648711  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:39.657122  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.648129  5870 raft_consensus.cc:1081] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:13:39.657871  4439 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:39.641810  5031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b524dfc86657460e8841456102df7e40"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:13:39.664324  5031 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.664695  5031 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.650102  5794 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44156 (request call id 169) took 3850 ms. Trace:
I20260709 12:13:39.610435  5822 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.681798  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.682463  4437 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
W20260709 12:13:39.712006  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 249396us
I20260709 12:13:39.677703  5027 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:39.724321  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.715929  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.725028  4441 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:39.731411  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.648685  5866 consensus_queue.cc:1059] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:13:39.746770  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:39.748827  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.751493  4436 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:39.751351  5872 consensus_queue.cc:1059] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:13:39.754765  5872 raft_consensus.cc:3055] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.756284  4331 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:39.761349  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.762612  5854 raft_consensus.cc:3055] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.763090  5854 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:39.763918  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:39.764528  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:39.760309  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.768186  4512 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.768981  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.755214  5872 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:39.755746  5805 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.797495  5859 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.798087  5859 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:39.802198  4359 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:39.811331  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.806617  5872 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.813417  5872 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.767839  5866 consensus_queue.cc:1243] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:39.819977  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.829680  4434 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
W20260709 12:13:39.841969  5817 consensus_meta.cc:287] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.653s	user 0.002s	sys 0.008s
I20260709 12:13:39.803018  5805 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.845213  5805 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:39.845404  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.846900  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.847558  4507 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.853098  5031 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.862304  5839 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.864879  5761 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.867372  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.678975  5794 rpcz_store.cc:276] 0709 12:13:35.798079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.821535 (+ 23456us) service_pool.cc:224] Handling call
0709 12:13:36.010944 (+189409us) ts_tablet_manager.cc:934] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
0709 12:13:38.807449 (+2796505us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:39.399754 (+592305us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:39.410269 (+ 10515us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:39.588931 (+178662us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:39.614482 (+ 25551us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:39.637283 (+ 22801us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:39.642031 (+  4748us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":73219,"tablet-copy.queue_time_us":173796,"thread_start_us":80379,"threads_started":2}
I20260709 12:13:39.867748  4514 raft_consensus.cc:1240] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.868427  5761 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:39.868880  5839 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:13:39.865809  5797 consensus_meta.cc:287] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.601s	user 0.002s	sys 0.011s
I20260709 12:13:39.874158  5770 raft_consensus.cc:3055] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.799036  5859 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:39.885946  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.887966  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.901319  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:39.902590  5860 log.cc:927] Time spent T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.448s	user 0.000s	sys 0.003s
I20260709 12:13:39.888612  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.899757  5797 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.907526  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:39.880488  5815 consensus_meta.cc:287] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
I20260709 12:13:39.915418  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.889170  5846 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:39.927984  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 289085us
I20260709 12:13:39.927037  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.930667  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.911731  5794 tablet_copy_client.cc:806] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:39.889760  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:39.899969  5770 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:39.893793  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:39.934624  5031 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.934743  4511 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:39.916944  5797 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.908625  5854 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.955665  5854 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.965817  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.912375  5835 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.919019  5818 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.968694  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
W20260709 12:13:39.969566  5861 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.439s	user 0.008s	sys 0.007s
I20260709 12:13:39.976671  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:39.963886  5816 consensus_meta.cc:287] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.005s
I20260709 12:13:39.975479  4514 raft_consensus.cc:606] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
W20260709 12:13:39.976136  5875 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:13:39.977340  4434 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:39.971268  5770 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:39.981600  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.985256  4515 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.986178  4358 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:39.986300  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.989280  5819 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:39.991739  4510 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:39.993705  4513 raft_consensus.cc:1240] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.995853  5835 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.998126  5846 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:39.999943  5818 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:40.000597  5853 consensus_meta.cc:287] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.007s
I20260709 12:13:40.000984  5853 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.002543  4512 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:40.003959  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.981706  5816 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:40.004739  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.998132  5856 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.007369  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.009173  4506 raft_consensus.cc:1240] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:13:40.010673  4996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.003718  5770 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:39.978189  4997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.032s
I20260709 12:13:39.978281  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:39.954193  5794 tablet_copy_client.cc:670] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:39.969560  5800 consensus_meta.cc:287] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
I20260709 12:13:40.039829  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.002779  4509 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:40.049232  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:40.047923  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 63734.4us
I20260709 12:13:40.005636  5872 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:40.040509  4997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.010s	sys 0.032s
I20260709 12:13:40.057049  4438 raft_consensus.cc:2410] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:40.057449  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.058277  4997 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:40.066226  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.069995  4366 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.073984  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.075294  4434 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.064749  5872 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:40.079886  5817 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.041667  5853 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:40.079417  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.080286  5817 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:40.081768  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.081871  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.058487  5856 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:40.083391  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.084937  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:40.086547  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.088238  4366 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.090055  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.088976  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.075918  5706 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.096230  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.098562  4360 raft_consensus.cc:3055] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.098874  4360 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.097281  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.103101  4434 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.059712  5800 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.107672  5874 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:40.108515  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.085196  5817 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.137127  4366 raft_consensus.cc:3055] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.106253  5872 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:40.137545  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.138324  4361 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.101541  4360 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:40.104799  5796 consensus_meta.cc:287] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.005s
I20260709 12:13:40.093113  5819 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:40.100122  5863 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.101269  5849 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.081080  5854 consensus_queue.cc:1059] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:13:40.145382  4366 raft_consensus.cc:740] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.096673  5870 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.108932  5706 raft_consensus.cc:697] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:40.165107  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.173508  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:40.151046  5878 log.cc:927] Time spent T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:40.182104  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.160851  5796 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.146795  5838 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:13:40.185335  4441 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:40.200162  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.205770  5800 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:40.217427  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:40.219137  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 119575us
I20260709 12:13:40.220170  5849 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.220580  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:40.222867  5870 raft_consensus.cc:3055] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.223225  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.223448  5870 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:40.224570  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.174347  5872 consensus_queue.cc:1059] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:13:40.222734  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.224423  5870 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.225231  4433 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:40.206756  5816 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:40.235976  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.239464  5706 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:40.243814  5026 raft_consensus.cc:1240] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:40.247404  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.248461  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:40.249828  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.251305  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.252741  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.254002  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.255046  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.255244  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.256341  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.256477  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.256954  4436 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:40.257246  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.257104  5859 consensus_queue.cc:1059] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:40.257872  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.258075  5859 consensus_queue.cc:1243] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:40.258489  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.259012  5796 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:40.259150  4441 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:40.260592  4507 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:40.260833  4331 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:40.263777  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.257148  4435 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
W20260709 12:13:40.265275  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 99049.5us
I20260709 12:13:40.266129  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:40.267421  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 160783us
I20260709 12:13:40.268759  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.275355  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.280509  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.281683  4437 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:40.282222  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.283537  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.282662  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.285108  4441 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:40.287514  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.291591  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.303864  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:40.297600  4332 leader_election.cc:336] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Timed out: RequestConsensusVote RPC to 127.3.34.194:33573 timed out after 1.564s (SENT)
I20260709 12:13:40.304557  4433 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:40.305313  4437 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:40.271354  5870 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.395705  5865 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:40.398481  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.304911  4332 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:40.271652  5839 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:40.468345  4996 leader_election.cc:336] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.532s (SENT)
I20260709 12:13:40.261307  5817 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:40.517932  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:40.480250  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 82392.2us
I20260709 12:13:40.511842  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.268559  5848 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.244s
W20260709 12:13:40.498696  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.534360  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 236807us
W20260709 12:13:40.545948  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.534451  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.548807  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.550326  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.552801  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:40.292972  5829 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.211s
W20260709 12:13:40.565182  5879 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
W20260709 12:13:40.566046  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 97726.2us
I20260709 12:13:40.293452  5806 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.227s
I20260709 12:13:40.573055  4507 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:40.469627  5861 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 12:13:40.426915  5850 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:13:40.579658  4996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.580145  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.575654  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.596326  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.469112  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.562700  5839 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.576637  5796 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.604851  4514 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.574908  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.593986  5028 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.616866  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.591890  5857 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:40.623092  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.629803  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.633845  5820 raft_consensus.cc:3055] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.634541  5820 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:40.635762  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.636413  4506 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.639003  5817 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:40.640595  5027 raft_consensus.cc:1240] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:40.645452  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.622931  5770 consensus_meta.cc:287] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.004s
I20260709 12:13:40.608820  4509 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:40.648133  5851 consensus_queue.cc:1059] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:13:40.653733  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.656729  4435 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:40.660226  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.661051  4510 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.663586  5026 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:40.664108  5839 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.664729  5851 consensus_queue.cc:1243] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:40.673147  5853 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:40.675028  5820 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.676730  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.678488  4360 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.676261  5820 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.679409  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:40.680689  5880 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 12:13:40.680498  5806 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:40.686774  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:40.687143  5865 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.687419  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.688874  5851 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.691474  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.692101  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.796016  4365 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:40.796955  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.644927  5857 raft_consensus.cc:697] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.693420  4362 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.698184  5686 raft_consensus.cc:3055] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.799981  5686 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:40.799710  5857 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:40.800901  5686 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.801707  4506 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:40.801985  5686 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.700361  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:40.804095  5865 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:40.805122  4511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47848 (request call id 944) took 1794 ms (client timeout 1822 ms). Trace:
I20260709 12:13:40.805357  4364 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:40.805562  4511 rpcz_store.cc:269] 0709 12:13:39.010501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.032503 (+ 22002us) service_pool.cc:224] Handling call
0709 12:13:40.804931 (+1772428us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400185bd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:40.805041 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861300480}
I20260709 12:13:40.808252  5865 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:40.808573  4405 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:40.809968  4996 leader_election.cc:336] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.721s (SENT)
I20260709 12:13:40.810410  4996 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:40.811920  5838 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.811822  5849 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:40.812983  4996 leader_election.cc:336] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.843s (SENT)
I20260709 12:13:40.813884  5888 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.700448  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.817261  4515 raft_consensus.cc:2393] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:40.817795  5863 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:40.818312  5863 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.703162  5872 consensus_queue.cc:1059] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.701375  4513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1445) took 1007 ms. Trace:
I20260709 12:13:40.806679  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.709458  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.819599  5872 raft_consensus.cc:3055] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.703914  4510 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:40.820147  4508 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:40.820506  5806 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.821427  4510 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:40.821630  4511 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:13:40.720824  5794 tablet_copy_client.cc:538] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:40.723822  4363 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:40.726565  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.727491  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.728024  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.795074  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.832839  4331 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:40.818128  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:40.717512  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.728830  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.778635  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.768754  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.835104  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:40.835322  4332 leader_election.cc:336] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Timed out: RequestConsensusVote RPC to 127.3.34.194:33573 timed out after 1.713s (SENT)
I20260709 12:13:40.726843  4440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:13:40.835908  4440 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:40.749805  4514 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:40.836470  4440 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.824070  4261 catalog_manager.cc:5697] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.819238  4513 rpcz_store.cc:276] 0709 12:13:39.694102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:39.694256 (+   154us) service_pool.cc:224] Handling call
0709 12:13:39.694553 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.994149 (+299596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.701116 (+706967us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000cfb54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:40.701312 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687540480}
I20260709 12:13:40.819995  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.837231  4514 raft_consensus.cc:1240] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:13:40.730434  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.833721  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.844208  4511 raft_consensus.cc:2393] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:40.743366  4360 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:40.845221  4438 raft_consensus.cc:2393] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:40.748451  4366 consensus_queue.cc:260] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:40.846879  4366 raft_consensus.cc:3060] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.802772  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:40.854236  4996 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:40.863155  4331 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:40.866564  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.860201  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.870481  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.871795  4261 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.860384  4366 raft_consensus.cc:1275] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:40.820063  5872 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:40.844466  4515 raft_consensus.cc:2376] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2. Re-sending same reply.
I20260709 12:13:40.852774  4514 raft_consensus.cc:1240] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.868769  4512 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:40.872970  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.865188  5686 consensus_queue.cc:1059] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:40.887410  5686 raft_consensus.cc:3055] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.887830  5686 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:40.888687  5686 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.889899  4507 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:40.885490  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.851310  5839 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.891165  5839 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.891306  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.891472  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.892093  4441 raft_consensus.cc:2393] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:40.863152  5851 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:13:40.892374  4363 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.892921  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:40.895272  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.896247  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:40.896878  5894 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:40.892097  5839 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.890020  5686 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.822814  5806 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:40.880398  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.901787  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.903899  4359 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.902355  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.905478  4360 raft_consensus.cc:2393] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:40.902212  4440 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:40.871340  5821 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.910789  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.911556  4361 raft_consensus.cc:2393] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:40.872669  5848 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.914213  4362 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.909827  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:40.916654  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.925182  4440 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:40.925634  4360 raft_consensus.cc:1240] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:40.926596  4365 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.926936  4360 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.923079  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.934489  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:40.936951  5766 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.870462  5846 consensus_queue.cc:1059] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:13:40.945253  5891 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:40.913774  5867 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:13:40.953222  4362 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:13:40.946846  4432 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:40.947711  4440 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:40.948592  4361 raft_consensus.cc:1240] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:40.949186  4363 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:40.956255  4362 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:40.950276  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:40.961826  5027 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.963879  4440 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.965368  5796 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.965817  5796 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.968258  5829 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:40.968567  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:40.969874  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:40.971195  5870 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.971751  5870 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:40.950906  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:40.945888  5891 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:40.958240  4362 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.982293  4434 raft_consensus.cc:2410] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:40.958448  4359 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:40.959535  5761 raft_consensus.cc:993] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:40.961223  5846 raft_consensus.cc:3055] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.974923  4436 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:40.976505  4366 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.925654  5854 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:40.913434  5798 consensus_queue.cc:1059] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:13:40.983677  4364 raft_consensus.cc:1240] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.984308  4996 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:40.986315  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:40.987830  5588 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:41.007138  5588 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:40.983639  4510 raft_consensus.cc:3055] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.005731  5891 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:41.008334  4510 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:41.000567  5815 raft_consensus.cc:1081] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:13:41.009171  4996 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.009435  4510 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.010485  4996 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:41.010943  5027 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:40.987411  5890 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.011826  5031 raft_consensus.cc:1240] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 3. Ops: []
I20260709 12:13:40.992388  4481 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:40.973083  5848 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:40.972730  5870 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.012542  5854 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.011591  5865 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.015172  4331 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:13:41.015827  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.994782  5846 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:41.018011  4996 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.010597  4510 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.024415  4405 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:13:41.031399  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45206.9us
I20260709 12:13:41.011178  5821 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.030618  5857 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.966711  5796 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.015903  5815 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.016752  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.047672  4362 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.040169  5588 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.047128  4996 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.014550  5798 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.973990  5872 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:41.060662  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 43991.3us
I20260709 12:13:41.031539  5822 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.063175  4363 raft_consensus.cc:1240] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 3. Ops: []
I20260709 12:13:41.063485  5588 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.053735  4332 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.041584  5873 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.069483  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.065729  4996 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.071087  5588 raft_consensus.cc:697] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:41.055467  5825 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.074589  4332 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.063812  5819 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.063812  5828 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.063789  5798 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:41.083048  4332 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.085816  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.072988  5857 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.073227  5854 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.088258  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.092869  4332 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.094511  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.096298  4481 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.090063  5588 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.081197  5806 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.100365  5849 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.099833  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.080303  5822 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:41.086745  5761 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.085642  5829 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.085352  5872 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.034061  5848 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.116384  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.095471  5815 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.127728  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.142925  5822 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.143676  5868 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:13:41.144200  5849 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.097501  5853 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.097488  5891 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.153049  5856 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.117563  5857 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.159859  5857 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:41.160341  5857 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.096866  5863 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.151575  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:41.120939  5805 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.118827  5816 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.182289  5876 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.119902  5798 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.192992  5798 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.196954  4362 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.172930  5818 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.173867  5817 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:13:41.225296  4435 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:41.210949  5818 raft_consensus.cc:697] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:41.238615  4510 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:41.242148  5863 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:41.215603  5876 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.283691  5868 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:41.293212  5821 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.296372  5031 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:41.300089  5876 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.315995  4514 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.321363  4508 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.321569  4513 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:41.323271  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:41.323974  4509 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.330489  5835 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:41.334824  5794 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
W20260709 12:13:41.353780  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 329421us
I20260709 12:13:41.376919  5873 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:41.378007  5873 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:41.395951  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 405674us
I20260709 12:13:41.396867  4439 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:41.332001  5797 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:13:41.403882  5588 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:41.404610  5588 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.406410  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.407472  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.406663  5588 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.411659  4511 raft_consensus.cc:1240] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.412147  4510 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:41.417330  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.323309  5818 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.423036  5891 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:41.424001  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.424435  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.428984  4440 raft_consensus.cc:1240] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.429471  4441 raft_consensus.cc:1240] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 3. Ops: []
I20260709 12:13:41.430775  4507 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
W20260709 12:13:41.437870  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 258532us
I20260709 12:13:41.440680  5588 consensus_queue.cc:1059] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:41.468047  4366 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.476676  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:41.435882  4506 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.503703  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.510965  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.511363  4364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:13:41.511615  4511 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:41.506842  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:41.512172  4364 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:41.512696  4364 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.508401  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:41.516248  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 75480.7us
I20260709 12:13:41.518420  4362 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:41.519599  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:41.520215  4511 raft_consensus.cc:2376] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2. Re-sending same reply.
I20260709 12:13:41.499286  5839 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.538870  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:41.535547  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 63127.6us
W20260709 12:13:41.537117  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.541532  4407 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.526314  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:41.542672  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.543812  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.536586  5588 raft_consensus.cc:3055] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:41.546382  5588 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:41.547412  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.556249  5588 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:41.558346  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.561703  4407 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.562786  4407 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.563787  4407 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.564828  4407 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.559779  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.567982  5588 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.542816  5816 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.560918  5849 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.568251  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:41.546531  5839 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:41.574662  5890 consensus_meta.cc:287] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.004s
W20260709 12:13:41.575821  5918 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:13:41.577064  5911 log.cc:927] Time spent T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:13:41.549690  5761 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.601696  5857 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.588325  4407 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.527626  5872 consensus_queue.cc:1059] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:13:41.560567  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:41.578917  5685 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.566704  5856 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:13:41.614033  5685 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:41.616641  5685 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.595355  4514 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.597421  4510 raft_consensus.cc:2368] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3.
I20260709 12:13:41.607432  4407 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.587939  5854 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.579955  5817 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.580705  5888 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.588104  5820 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.606956  4364 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.589000  5796 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.621433  5819 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.595865  5890 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.611899  5858 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.591388  5903 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.593034  5873 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.633483  4996 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.647257  4364 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.638041  5686 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.648152  5821 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.635432  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.637990  5820 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:41.640487  5819 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.618736  5816 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.655970  5839 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.623207  5854 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:41.659736  4996 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:41.660770  4407 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.622833  4507 raft_consensus.cc:2376] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3. Re-sending same reply.
I20260709 12:13:41.658152  5888 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.670414  5872 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.670171  5854 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.670900  5872 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:41.671216  5816 raft_consensus.cc:697] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:41.672720  5816 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.673688  5876 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.674238  5876 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.674619  5876 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.671384  5872 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:41.676900  4332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.001s	sys 0.007s
I20260709 12:13:41.663995  5820 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.646425  5903 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:41.677407  4332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.001s	sys 0.007s
W20260709 12:13:41.685726  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 591241us
I20260709 12:13:41.686807  4332 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.692108  4407 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.698624  5805 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.699167  5805 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:41.692279  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.702808  4996 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.704952  4407 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.688372  5903 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.707998  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.664706  5873 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.713785  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.714246  4332 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.733832  4332 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:41.751338  4996 leader_election.cc:400] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3.
I20260709 12:13:41.693480  5922 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.767550  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:41.706903  5839 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:41.751879  4407 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.699517  5846 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.753072  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:41.710913  5865 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.751749  4996 leader_election.cc:403] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:41.771095  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:41.752151  5588 consensus_queue.cc:1059] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:41.700011  5805 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:41.710428  5888 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.785156  4332 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.788501  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:41.763420  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.789637  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.758947  5858 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.792121  4332 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:41.752044  5798 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.758920  5857 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:41.758803  5859 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.767185  5912 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.751955  5906 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.807529  5846 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.797050  5025 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:41.796141  5851 raft_consensus.cc:2764] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:41.767311  5907 consensus_queue.cc:1059] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:13:41.796367  5867 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:41.798782  5922 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.848235  5876 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:41.815956  5819 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:41.856554  5820 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:41.861099  5865 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3.
I20260709 12:13:41.864108  5855 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:41.864588  5923 log.cc:927] Time spent T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:13:41.865571  5919 consensus_queue.cc:1059] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
W20260709 12:13:41.917831  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.918356  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.834386  5888 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.887825  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:41.875629  5922 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.844972  5798 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.890938  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:41.922784  4441 raft_consensus.cc:1240] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:13:41.922055  4434 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
W20260709 12:13:41.942660  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.911252  5855 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:41.925288  5891 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:42.032788  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.033385  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.924398  5922 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.922526  5798 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.020630  5858 raft_consensus.cc:3055] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:42.048564  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 296766us
I20260709 12:13:42.051235  4407 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:42.049908  5858 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:42.042367  5798 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.069854  4407 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:42.076428  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 366119us
I20260709 12:13:42.077312  4996 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:42.078132  4514 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:13:42.082293  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:42.072760  5854 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.091359  5926 raft_consensus.cc:2764] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:13:42.070744  4509 consensus_meta.cc:287] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.746s	user 0.000s	sys 0.013s
I20260709 12:13:42.101657  5929 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:42.108916  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.104959  5888 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:13:42.103901  4509 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:42.071380  5931 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.116477  5888 raft_consensus.cc:3055] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.115453  5820 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.076996  5873 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:42.118072  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 325988us
I20260709 12:13:42.108481  5816 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.116969  5888 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:42.123221  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:42.124019  4513 raft_consensus.cc:3055] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.124493  4513 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:42.124310  4332 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.127200  5588 consensus_queue.cc:1243] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:42.125928  4332 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:42.126760  5927 log.cc:927] Time spent T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:13:42.133797  4513 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.134653  4332 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.095039  5932 consensus_queue.cc:1059] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:42.126754  5796 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.118974  5751 raft_consensus.cc:2764] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:13:42.141631  4332 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.094133  5855 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.129091  5816 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.149662  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:42.159394  5888 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:42.166894  5925 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 12:13:42.142346  5934 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.170631  4513 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.171324  5897 log.cc:927] Time spent T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.595s	user 0.000s	sys 0.004s
I20260709 12:13:42.140281  5846 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:42.209506  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:42.186591  5876 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:42.192579  5685 consensus_meta.cc:287] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
I20260709 12:13:42.214568  4439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1590) took 1352 ms. Trace:
I20260709 12:13:42.219265  5816 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:42.219522  4506 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.190685  5806 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.213649  5685 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.222599  4440 raft_consensus.cc:1240] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.224211  5685 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.225273  5888 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:42.201548  5872 consensus_meta.cc:287] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:13:42.215142  4439 rpcz_store.cc:276] 0709 12:13:40.852869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.899112 (+ 46243us) service_pool.cc:224] Handling call
0709 12:13:42.205053 (+1305941us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400202bd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:42.205225 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864507776}
W20260709 12:13:42.186923  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44812.3us
I20260709 12:13:42.229840  4332 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.231215  4332 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.190461  5855 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.232426  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:42.234386  5806 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:42.242756  5917 log.cc:927] Time spent T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.597s	user 0.002s	sys 0.003s
W20260709 12:13:42.244378  5928 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:13:42.241405  5806 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.250312  5806 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:42.254571  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 158415us
W20260709 12:13:42.256289  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.242836  5024 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:42.268476  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:42.212275  5846 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.226751  4507 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:42.271100  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.244331  5891 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.276953  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.276227  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.278163  4432 raft_consensus.cc:2410] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:42.279013  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.279657  4432 raft_consensus.cc:2393] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:42.280113  5588 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.274437  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:42.280884  5588 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.280056  4332 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.285368  4332 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.288705  4437 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:42.287883  4332 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.265532  5934 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.137590  5858 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.291731  4479 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:42.299247  5588 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:42.294349  4434 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.241734  5872 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.272086  5846 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.281154  5815 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:42.265949  5685 consensus_queue.cc:1059] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:13:42.306918  4513 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:42.290545  5839 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.301293  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.290836  5851 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.288053  5867 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:42.295383  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.311275  4508 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:42.320254  4436 raft_consensus.cc:1240] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.285826  5796 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.321869  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.322623  4437 raft_consensus.cc:2393] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:42.322490  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.317657  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.324556  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.309047  5815 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.325551  5815 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.326134  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.331103  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:42.333010  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.334285  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.334766  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.335350  4437 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.336570  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.276988  5873 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:13:42.299993  5820 consensus_queue.cc:1059] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:13:42.353130  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:42.334882  4438 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:42.316769  5798 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.321983  5867 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.353194  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.361159  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.363437  4438 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.351760  5937 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.369367  5935 consensus_queue.cc:1059] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:42.370110  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.370299  5798 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.371440  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.330526  5863 consensus_queue.cc:1059] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:13:42.359622  5891 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.376219  4434 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.381243  4366 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:42.382149  5819 raft_consensus.cc:3055] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:42.382618  5819 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:42.378798  4434 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:42.364205  5867 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.362228  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:42.384083  4434 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.389635  4332 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.378670  5891 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.396716  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.387482  5854 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.393433  4434 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.388885  5798 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.420346  5751 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.420957  5751 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.421721  5806 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:42.426769  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.427350  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.427747  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.405293  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 482794us
I20260709 12:13:42.397913  5891 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.399574  5797 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.409379  4438 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:42.439249  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.442327  4332 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.432418  5872 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.472605  4997 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.459630  4332 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:42.436790  5912 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.487406  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:42.410775  5940 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.491961  5858 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.406818  5819 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.432212  5798 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.471930  5873 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.504967  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:42.492990  5903 consensus_meta.cc:287] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.002s
I20260709 12:13:42.510589  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:42.501055  5859 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.502019  5835 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.517776  4364 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:42.485786  5865 consensus_queue.cc:1048] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:13:42.517257  5859 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.534216  4434 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:42.536706  5943 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.541522  4437 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:42.526515  5835 raft_consensus.cc:697] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:42.553095  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 278733us
I20260709 12:13:42.557170  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.561365  4434 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:42.532279  5751 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:42.535825  5859 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.503290  5940 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.579807  4508 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:42.512856  5903 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.581394  5028 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:42.591919  4435 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.587670  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 257810us
I20260709 12:13:42.611474  5940 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.534837  5922 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.580174  5857 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:13:42.593289  5868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.052s	sys 0.085s
I20260709 12:13:42.621847  4435 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:42.622470  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:42.626041  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:42.629613  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:42.630640  4508 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:42.638046  4363 raft_consensus.cc:1240] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:42.582832  5835 consensus_queue.cc:237] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.645018  4406 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:42.615592  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:42.651222  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.636302  5868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.052s	sys 0.086s
W20260709 12:13:42.652928  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.637104  5820 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.646768  5854 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.656172  5888 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.615828  5926 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:13:42.661880  4510 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:42.707931  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.637949  5940 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:13:42.675618  5798 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:42.700400  5937 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:42.728193  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:42.664870  5948 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:13:42.696242  5888 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.680781  5854 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.731333  5954 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:13:42.788468  4434 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:42.695643  5820 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.771416  5943 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:42.783804  5888 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.773411  5863 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:42.809791  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:42.822882  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.830188  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.831271  4360 raft_consensus.cc:1240] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.831979  4358 raft_consensus.cc:2410] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:42.834125  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.836666  4360 raft_consensus.cc:1240] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.837754  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:42.840097  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:42.841078  4360 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:42.843549  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:42.844571  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:42.845974  4360 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.858889  5922 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:42.860347  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.862826  4436 raft_consensus.cc:1240] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.803506  5943 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.869304  4366 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:42.898856  5962 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:42.804891  5846 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.809119  5863 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.874837  5854 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:42.883085  5946 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:13:42.883617  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:42.884449  4510 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
W20260709 12:13:42.886447  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.930629  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.810160  5903 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.865347  4361 raft_consensus.cc:1240] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.934398  5025 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:42.925225  5855 consensus_meta.cc:287] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.659s	user 0.001s	sys 0.011s
I20260709 12:13:42.899516  5962 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:42.924433  5867 consensus_meta.cc:287] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.005s
I20260709 12:13:42.867069  5937 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.948127  5932 raft_consensus.cc:3055] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.948590  5932 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:42.939046  5839 consensus_meta.cc:287] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
I20260709 12:13:42.951481  5839 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.936246  5891 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.953809  5891 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:42.940277  5907 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:13:42.908890  5870 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:42.942252  4509 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:42.913223  4331 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:42.943425  5820 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:42.944411  5846 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:42.944762  5796 consensus_meta.cc:287] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.002s
I20260709 12:13:42.945132  4432 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:42.957476  5863 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:42.957991  5906 raft_consensus.cc:3055] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.959373  4330 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:42.942837  5815 consensus_meta.cc:287] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 12:13:42.961134  5797 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:13:42.965312  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 52208.6us
W20260709 12:13:42.973762  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.974797  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:42.957192  5867 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:42.985944  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.987221  5873 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:42.989259  5873 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.991132  4366 raft_consensus.cc:1240] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.991972  5798 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:42.995201  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:42.996080  5031 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.996937  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.999397  4366 raft_consensus.cc:1240] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:43.000991  5867 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:42.965581  5796 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.003436  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:42.964910  5820 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.967253  5851 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.006328  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:43.008563  4441 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.008494  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:42.949963  5932 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.007439  5956 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.006508  4357 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:42.966099  5906 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:43.010263  4407 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.014874  5906 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.015622  5935 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.016340  5906 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.973518  5859 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:43.023198  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.962069  5870 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:42.970736  5943 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.029770  5031 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:43.035531  4364 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:43.047765  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:43.050449  4407 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.052623  4407 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.056097  4407 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.029464  5962 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.026199  5963 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.062462  4407 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:42.970897  5815 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.064198  4506 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.030472  5851 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:43.064966  5962 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.059809  5686 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.012130  5820 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.061470  5854 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.073599  4515 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:43.061957  5872 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.027482  5903 consensus_queue.cc:1059] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:43.074354  4407 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.002540  5907 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:13:43.078428  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:43.067922  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:43.086329  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 263769us
I20260709 12:13:43.089200  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:43.090294  5031 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.091630  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.096275  4441 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:43.060272  5956 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.065194  5961 consensus_queue.cc:1059] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:43.099264  4996 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:43.099225  5937 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:43.137164  5794 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:43.137224  5937 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.138374  5794 tablet_bootstrap.cc:492] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:13:43.139211  5794 ts_tablet_manager.cc:1403] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 1.805s	user 0.038s	sys 0.026s
I20260709 12:13:43.101667  4441 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:43.130196  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:43.099627  5031 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:43.127552  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 140831us
I20260709 12:13:43.130604  4360 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.132368  4479 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:43.128302  4359 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:43.098007  5686 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.101511  4407 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.100445  5839 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.146642  5851 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.141968  5933 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.147799  5888 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.149986  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:43.150189  5888 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.143147  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.134196  5835 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:43.140033  5962 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:43.153800  5937 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.154150  5962 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.155412  5815 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.071172  5963 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.156387  5962 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.157510  5963 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:43.159762  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.161136  5933 raft_consensus.cc:697] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:43.161975  5820 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.142567  5805 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:43.165191  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 63746us
W20260709 12:13:43.172788  5858 consensus_meta.cc:287] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.007s
I20260709 12:13:43.213918  5961 consensus_queue.cc:1059] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:43.216570  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:43.217248  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:43.188023  5820 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:43.213918  5937 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.220772  5806 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.221976  5854 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.179356  5972 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.224396  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:43.226068  5796 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:43.226236  4331 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.228134  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.162325  5933 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.228029  5963 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:43.167968  5891 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.188467  5907 consensus_queue.cc:1059] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:13:43.231900  5919 consensus_queue.cc:1059] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.232163  5948 consensus_queue.cc:1059] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:43.232798  4440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37844 (request call id 1610) took 1463 ms. Trace:
I20260709 12:13:43.168155  5686 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.229157  5870 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.234928  5969 consensus_queue.cc:1059] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:13:43.235981  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.236155  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:43.236089  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:43.237287  5962 raft_consensus.cc:3055] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.237600  4439 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:43.240206  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.240710  4435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1607) took 1474 ms. Trace:
I20260709 12:13:43.240222  4509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 998) took 1117 ms. Trace:
I20260709 12:13:43.242506  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.243283  4433 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.243865  5939 raft_consensus.cc:3055] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.244608  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.231581  5819 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.263296  4331 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.266131  5761 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.281137  4440 rpcz_store.cc:276] 0709 12:13:41.769244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.769395 (+   151us) service_pool.cc:224] Handling call
0709 12:13:41.769744 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.223020 (+453276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.232524 (+1009504us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400087354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:43.232715 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040968576}
I20260709 12:13:43.166389  5970 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.292326  4435 rpcz_store.cc:276] 0709 12:13:41.767099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.767260 (+   161us) service_pool.cc:224] Handling call
0709 12:13:43.240490 (+1473230us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002c5e54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.240630 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894202624}
I20260709 12:13:43.270778  5839 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.272662  5024 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:43.301918  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:43.267441  5952 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:13:43.258709  5820 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.291585  5962 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:43.267844  5972 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.324069  5962 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.325335  5972 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.326541  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:43.319314  4440 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.328785  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.329952  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.299094  5686 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.310213  5970 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:43.333039  5971 log.cc:927] Time spent T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:13:43.338456  4405 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:43.298367  5939 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.284276  5891 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:43.314307  5868 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.316165  5974 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.320168  5815 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.367877  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:43.369293  4357 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:43.369604  4362 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:43.370822  4513 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:43.306155  5870 consensus_queue.cc:1059] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:13:43.372283  4366 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.307725  5761 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.381109  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:43.381886  4357 raft_consensus.cc:2393] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:43.348475  5952 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.349800  5963 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.352106  5907 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.381260  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:43.384817  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 113900us
I20260709 12:13:43.391784  4363 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.376051  5937 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.399192  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:43.294682  4509 rpcz_store.cc:276] 0709 12:13:42.122318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.128700 (+  6382us) service_pool.cc:224] Handling call
0709 12:13:42.730796 (+602096us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800054f98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:42.933185 (+202389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.961993 (+ 28808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.239891 (+277898us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54003df750. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.240107 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464808064}
I20260709 12:13:43.396834  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:43.403614  4332 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.416540  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:43.417214  4437 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.347890  5686 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:43.420979  4332 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:43.396736  5907 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.390895  5963 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.381397  5815 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.407052  5929 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.408712  5806 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.379340  5974 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.419515  5870 raft_consensus.cc:3055] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.424751  5972 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.437207  4437 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:43.436497  4363 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:43.427702  5907 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.438862  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.440150  5868 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:13:43.441468  5976 log.cc:927] Time spent T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:13:43.431942  5857 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:43.442338  5970 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.442739  5857 raft_consensus.cc:697] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:43.443621  5857 consensus_queue.cc:237] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.444171  4437 raft_consensus.cc:1240] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:13:43.445434  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.445791  4432 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:43.447048  4437 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.437194  5870 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.453500  5963 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:43.455040  5975 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:13:43.463857  5970 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.464440  5970 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.463594  5870 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.466799  5891 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.466882  5970 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.468187  5820 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.468281  5761 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.466892  5870 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.468778  5933 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.470378  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.470098  5933 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.470796  4514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 996) took 1366 ms. Trace:
I20260709 12:13:43.471088  4432 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:43.471227  4514 rpcz_store.cc:276] 0709 12:13:42.104879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.105470 (+   591us) service_pool.cc:224] Handling call
0709 12:13:42.105926 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.106850 (+   924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.106898 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.107557 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:13:42.552583 (+445026us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:42.552626 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.552696 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:43.469878 (+917182us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b24001f1648. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124ae869c4 00007f124ae84acb 00007f124b03fdc9 00007f124b03fa55 00007f124b03efb0 00007f124dcb5488 00007f124dcb5be8 00007f124dc8d398 00007f124dc8876a 00007f124dc87bb6
0709 12:13:43.470498 (+   620us) raft_consensus.cc:1685] finished
0709 12:13:43.470518 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.470736 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311,"raft.queue_time_us":48338,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":28487552,"thread_start_us":419927,"threads_started":1,"wal-append.queue_time_us":541205}
I20260709 12:13:43.472929  4512 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.472823  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.473173  5933 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.474911  5922 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.475528  5922 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:43.477067  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.478137  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.436342  5028 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:43.472595  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.396942  5952 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:43.439348  5982 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.484738  5806 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.395231  5937 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.497972  5806 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.489352  5839 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.493153  5797 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.496265  5835 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.484481  5794 raft_consensus.cc:359] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:43.553550  5794 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:13:43.420441  5939 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.531234  5797 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.556059  5797 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.434943  5929 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.556164  5952 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.493099  5922 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:43.543319  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.550769  5686 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.552263  4507 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:43.538136  5839 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.584342  5929 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.512252  5974 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.586396  5972 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.611327  5972 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.587016  5815 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.578534  5835 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.615658  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:43.638924  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 144011us
I20260709 12:13:43.613745  5939 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.510031  5982 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.619109  5822 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:13:43.653844  4512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1483) took 1366 ms. Trace:
I20260709 12:13:43.654337  4512 rpcz_store.cc:276] 0709 12:13:42.287453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.287759 (+   306us) service_pool.cc:224] Handling call
0709 12:13:43.472757 (+1184998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.473363 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.653610 (+180247us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002f3850. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.653777 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679765248}
I20260709 12:13:43.654819  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.646622  5839 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.658084  5839 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.658597  5839 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.643026  5926 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:13:43.660694  5835 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.642863  5922 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:43.667178  5806 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.643563  5794 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:43.673218  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:43.675608  5872 raft_consensus.cc:3055] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.676071  5872 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:43.679246  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.663422  5839 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.677122  5907 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:43.689419  4481 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.930s (SENT) [suppressed 49 similar messages]
I20260709 12:13:43.675587  5794 ts_tablet_manager.cc:1434] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.536s	user 0.008s	sys 0.011s
W20260709 12:13:43.699215  5794 ts_tablet_manager.cc:1467] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Tablet startup took 559ms
I20260709 12:13:43.676970  5872 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.717727  5970 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.727207  5982 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.724427  5970 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.731402  4433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1053) took 1406 ms. Trace:
I20260709 12:13:43.731914  4433 rpcz_store.cc:276] 0709 12:13:42.324839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.325458 (+   619us) service_pool.cc:224] Handling call
0709 12:13:43.243025 (+917567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.297790 (+ 54765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.731087 (+433297us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54002c5e50. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.731315 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109380480}
I20260709 12:13:43.736366  5970 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.722862  5956 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.737620  5872 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:43.739698  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.741739  4439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37854 (request call id 1054) took 1416 ms (client timeout 1853 ms). Trace:
W20260709 12:13:43.742307  4439 rpcz_store.cc:269] 0709 12:13:42.325164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.325892 (+   728us) service_pool.cc:224] Handling call
0709 12:13:43.741493 (+1415601us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54001563d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.741658 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094657792}
I20260709 12:13:43.744527  4438 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:43.715152  5794 ts_tablet_manager.cc:1469] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Trace:
0709 12:13:35.798079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.821535 (+ 23456us) service_pool.cc:224] Handling call
0709 12:13:36.010944 (+189409us) ts_tablet_manager.cc:934] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
0709 12:13:38.807449 (+2796505us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:39.399754 (+592305us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:39.410269 (+ 10515us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:39.588931 (+178662us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:39.614482 (+ 25551us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:39.637283 (+ 22801us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:39.642031 (+  4748us) inbound_call.cc:177] Queueing success response
0709 12:13:41.334418 (+1692387us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:13:43.139530 (+1805112us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:13:43.229559 (+ 90029us) tablet_replica.cc:261] Starting instrumentation
0709 12:13:43.312884 (+ 83325us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":73219,"mutex_wait_us":9014,"raft.queue_time_us":4334,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11901,"tablet-copy.queue_time_us":173796,"tablet-download-pool.queue_time_us":3373,"tablet-download-pool.run_cpu_time_us":1453,"tablet-download-pool.run_wall_time_us":661076,"thread_start_us":80379,"threads_started":2}
I20260709 12:13:43.748879  5948 raft_consensus.cc:3055] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.749464  5948 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.746479  4438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1062) took 1398 ms. Trace:
I20260709 12:13:43.752161  4438 rpcz_store.cc:276] 0709 12:13:42.347768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.471578 (+123810us) service_pool.cc:224] Handling call
0709 12:13:43.744043 (+1272465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.745062 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.746205 (+  1143us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001563d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:43.746400 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925481728}
I20260709 12:13:43.753342  5932 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.754789  5963 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.750660  5948 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.763926  5948 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.784274  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:43.785138  5028 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.789177  4263 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.342140  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:43.798606  4440 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:43.802172  4996 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:43.808645  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 187432us
I20260709 12:13:43.816494  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.793349  5907 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.803645  5938 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.808982  5926 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.812088  5954 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.833945  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-011d2125e98642bfaa9d1a5c58747e7e received from {username='slave'} at 127.0.0.1:55510
I20260709 12:13:43.826522  5938 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.848487  5937 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.833128  5954 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.851912  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:43.852401  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:43.852831  4357 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:43.840492  5846 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.846541  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-011d2125e98642bfaa9d1a5c58747e7e on tablet 011d2125e98642bfaa9d1a5c58747e7e with peer 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:13:43.863708  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 174328us
I20260709 12:13:43.865464  4330 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:43.849376  5937 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.871205  5939 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.871340  5849 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:43.874440  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:43.841672  5997 consensus_queue.cc:1059] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:13:43.894548  5846 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.895921  5954 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:43.886348  4515 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:43.897740  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:43.883078  5903 raft_consensus.cc:3055] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.880751  5941 raft_consensus.cc:3055] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:43.871816  5939 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:43.868239  5797 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:43.908681  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 48568us
I20260709 12:13:43.910225  4512 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:43.871831  5849 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:43.867596  5798 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:13:43.875352  5806 consensus_queue.cc:1059] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:13:43.930104  5846 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:43.913120  5941 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:43.912530  5903 raft_consensus.cc:740] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:43.969966  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:43.979281  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.918399  6002 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:43.985463  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.988387  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:43.990075  4438 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:43.990113  4437 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:43.994853  5806 consensus_queue.cc:1243] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:43.940187  5839 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.988593  4506 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.009003  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.010326  5903 consensus_queue.cc:260] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:44.011623  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.011996  5903 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.009858  5030 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:43.994100  6002 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.039703  6002 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:43.998208  5943 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:44.096467  5939 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:44.040531  6006 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:44.098021  6006 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.100612  5938 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.105705  5851 raft_consensus.cc:3055] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:44.106297  5851 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:44.107391  5851 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.111111  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.140878  4435 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.114178  4441 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.120966  5816 raft_consensus.cc:3055] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:44.123209  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.127384  5854 raft_consensus.cc:3055] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:44.128931  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.129081  5937 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:44.130043  6006 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.132890  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.167043  4439 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:44.167984  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.169173  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:44.169679  4439 raft_consensus.cc:2376] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3. Re-sending same reply.
I20260709 12:13:44.170291  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:44.133890  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.171209  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:44.171819  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.147459  5972 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.141746  4364 raft_consensus.cc:1240] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:44.142933  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.144454  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:44.146042  4508 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.146881  4358 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.173379  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.178500  4512 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:44.178864  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.179323  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.145962  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.148988  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.150440  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.180927  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.151371  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.152890  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.153067  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.180830  4441 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.153693  4481 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:44.147879  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.157097  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:44.003175  5839 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.183954  4365 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:44.163522  4515 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:44.185328  4360 raft_consensus.cc:2393] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:44.139250  4997 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:44.165086  4511 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.165275  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.178591  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.165627  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.179924  4512 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:44.171825  4439 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:44.165511  4260 catalog_manager.cc:5697] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.180095  4363 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.152340  4438 raft_consensus.cc:1240] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.179766  4358 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.197786  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.184772  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.200896  4365 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.187100  4508 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:44.149138  5816 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:44.211090  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.148064  5854 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:44.160027  5872 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:44.073709  5943 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.074851  5941 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.167510  5964 consensus_queue.cc:1059] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:13:44.159628  5817 consensus_queue.cc:1059] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:13:44.141840  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:44.509379  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.256049  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.233470  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.553668  4433 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:44.542100  5972 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:44.234663  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:44.510296  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.628672  5972 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:44.354323  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 215183us
I20260709 12:13:44.629333  5903 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:44.629936  5903 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:44.476733  4996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.023s	sys 0.042s
W20260709 12:13:44.630875  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.631060  5972 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.182083  5851 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:44.631235  4996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.023s	sys 0.045s
I20260709 12:13:44.631569  4407 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:44.632866  5903 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:44.632346  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 756831us
I20260709 12:13:44.254236  4332 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:13:44.581866  4436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.013s
I20260709 12:13:44.633445  5903 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:44.633672  4436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.014s
W20260709 12:13:44.634709  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 380564us
W20260709 12:13:44.511960  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.485256  6006 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:44.636915  4332 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:44.637451  5943 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.365020  4507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47840 (request call id 1487) took 2037 ms. Trace:
I20260709 12:13:44.637549  6006 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.624854  4481 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:44.627558  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.640322  4364 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:44.641392  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.642184  4364 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.643214  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.644026  4364 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:44.216729  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.645324  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.646239  4365 raft_consensus.cc:2410] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:44.647409  4365 raft_consensus.cc:1240] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.428639  5816 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.648674  5857 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:44.648841  5816 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.650324  4365 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:44.641013  5983 log.cc:927] Time spent T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 1.133s	user 0.011s	sys 0.007s
I20260709 12:13:44.650709  5846 raft_consensus.cc:3055] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:44.651156  5846 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:44.314410  4363 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:44.651809  5859 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.652738  5859 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.652303  5846 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.653173  5859 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.653609  5859 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.638866  4507 rpcz_store.cc:276] 0709 12:13:42.327656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.335095 (+  7439us) service_pool.cc:224] Handling call
0709 12:13:44.350728 (+2015633us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400059bd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:44.359079 (+  8351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679747328}
I20260709 12:13:44.651888  4364 raft_consensus.cc:1240] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.677624  5853 consensus_queue.cc:1059] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:44.679826  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.688019  4435 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:44.688306  5029 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:44.680661  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.678463  5865 raft_consensus.cc:3055] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:44.682122  4438 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.677484  5031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44156 (request call id 197) took 1421 ms. Trace:
I20260709 12:13:44.649281  5857 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.216686  4366 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:44.483069  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.624902  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.624131  4440 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:44.691753  4357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.122s	sys 0.105s
W20260709 12:13:44.700021  4357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.122s	sys 0.106s
W20260709 12:13:44.692175  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.693253  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.232976  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.690304  5031 rpcz_store.cc:276] 0709 12:13:43.256413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.256537 (+   124us) service_pool.cc:224] Handling call
0709 12:13:43.256869 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.257308 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.257348 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.257937 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.422605 (+164668us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:43.422661 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.422768 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.640196 (+1217428us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:13:44.655384 (+ 15188us) raft_consensus.cc:1685] finished
0709 12:13:44.655405 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.677359 (+ 21954us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2163,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":11995,"spinlock_wait_cycles":2702720,"thread_start_us":136358,"threads_started":1,"wal-append.queue_time_us":208662}
I20260709 12:13:44.210562  5937 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:44.696524  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 71753.1us
I20260709 12:13:44.702885  5863 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.198316  5939 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.705763  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 69990us
I20260709 12:13:44.696274  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.716889  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.717679  4359 raft_consensus.cc:2393] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:44.702970  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.614570  5849 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:44.729519  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.709012  4358 raft_consensus.cc:2393] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:44.366075  5822 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.717396  4511 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:44.677693  5027 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:44.485155  5867 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:44.734351  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.736052  5031 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:44.695746  5865 raft_consensus.cc:740] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:44.747637  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:44.704700  5818 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:44.704308  5857 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.710444  5972 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.715498  5937 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:44.788362  5031 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:44.793916  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.793973  4996 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:44.790300  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.798671  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:44.795975  6007 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:13:44.799400  4507 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:44.705359  5872 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.795162  5937 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.732342  5939 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.844811  5863 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:44.845125  5926 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:44.845532  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.801164  5854 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.846520  4507 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:44.847157  5854 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.847908  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.848762  4507 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:44.848922  5859 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.773921  5867 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.856151  6006 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.857090  5867 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:44.792987  5818 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.858280  5903 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.809710  5839 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.814170  6003 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:44.867209  4514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.011s
W20260709 12:13:44.867594  4514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.011s
I20260709 12:13:44.787907  6008 consensus_queue.cc:1059] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 12:13:44.878597  4437 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:44.794816  5972 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.900874  4507 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.910272  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:44.845535  5863 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.933929  5863 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:44.934491  5863 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.935231  5588 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:44.938364  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:44.939164  4510 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:44.939288  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:44.940133  4512 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:44.913211  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 281687us
I20260709 12:13:44.911379  4361 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:44.920423  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:44.922758  5972 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.928599  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:44.931727  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:44.932037  5028 consensus_meta.cc:287] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 1.146s	user 0.013s	sys 0.000s
I20260709 12:13:44.935755  5588 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.942826  4407 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:44.957294  4407 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:44.906810  5859 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.985415  5588 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:44.987941  4407 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:44.934899  5863 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.990859  5588 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.930830  5857 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:44.955715  5028 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:45.006386  5857 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.009146  5029 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:45.009235  4512 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:45.010846  5588 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.011534  5588 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.011897  5588 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:44.987349  5818 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.014624  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 142) took 4948 ms. Trace:
I20260709 12:13:45.014732  5588 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:44.989328  5854 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.020617  5854 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.017831  4261 rpcz_store.cc:276] 0709 12:13:40.061326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.061494 (+   168us) service_pool.cc:224] Handling call
0709 12:13:45.009326 (+4947832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.537502 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:41.582376 (+ 44874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:41.582427 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:13:41.582456 (+    29us) tablet.cc:662] Decoding operations
0709 12:13:41.583031 (+   575us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:41.583151 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:41.583194 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:41.583692 (+   498us) tablet.cc:701] Row locks acquired
0709 12:13:41.583721 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:13:41.583932 (+   211us) write_op.cc:270] Start()
0709 12:13:41.584090 (+   158us) write_op.cc:276] Timestamp: P: 1783599221583875 usec, L: 0
0709 12:13:41.584125 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:13:41.585123 (+   998us) log.cc:844] Serialized 913 byte log entry
0709 12:13:42.771931 (+1186808us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.064104 (+292173us) write_op.cc:301] APPLY: starting
0709 12:13:43.064217 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.064340 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.080955 (+ 16615us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.143629 (+ 62674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.143815 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:43.143868 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:43.144060 (+   192us) log.cc:844] Serialized 29 byte log entry
0709 12:13:43.144229 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.144319 (+    90us) write_op.cc:454] Released schema lock
0709 12:13:43.144362 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.144704 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.144731 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10969,"reported_tablets":9,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":248016,"apply.run_cpu_time_us":2594,"apply.run_wall_time_us":83373,"num_ops":2,"prepare.queue_time_us":570571,"prepare.run_cpu_time_us":41610,"prepare.run_wall_time_us":357849,"raft.queue_time_us":848060,"raft.run_cpu_time_us":59254,"raft.run_wall_time_us":686421,"replication_time_us":1187376,"spinlock_wait_cycles":1792,"thread_start_us":1447154,"threads_started":5,"wal-append.queue_time_us":328143}]]}
I20260709 12:13:45.015787  5903 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:45.025764  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 388896us
I20260709 12:13:45.014636  5028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44156 (request call id 200) took 1230 ms. Trace:
I20260709 12:13:45.024405  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:45.029806  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.032156  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 453) took 1042 ms. Trace:
I20260709 12:13:45.044914  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:45.034072  5863 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.034508  5856 raft_consensus.cc:3055] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:45.034937  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.037393  5588 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.047979  5588 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.045172  5025 rpcz_store.cc:276] 0709 12:13:43.989839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.989956 (+   117us) service_pool.cc:224] Handling call
0709 12:13:44.736706 (+746750us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:44.737024 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.782036 (+ 45012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.782085 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:44.782146 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:44.782193 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.031818 (+249625us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b54007814d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:45.031867 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.032078 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127204608}
W20260709 12:13:45.049572  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:45.019114  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 373931us
I20260709 12:13:45.052409  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:13:45.059850  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.048358  5856 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.064141  4332 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:45.065935  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:45.055573  5863 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:45.057742  5859 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.044272  5028 rpcz_store.cc:276] 0709 12:13:43.783758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.783915 (+   157us) service_pool.cc:224] Handling call
0709 12:13:45.010453 (+1226538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.089977  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:13:45.062134  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.085421  5851 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.094491  5851 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.094904  5851 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.085469  5972 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.099341  5972 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.099699  5972 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.103794  5805 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.104295  5805 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.103565  5856 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.104653  5805 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.105472  5856 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.110474  5939 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.058059  5865 consensus_queue.cc:260] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.082367  5854 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.113761  5846 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.087245  6003 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.115701  5024 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.089654  5863 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.118175  5863 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.121701  5030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 458) took 1094 ms. Trace:
I20260709 12:13:45.121990  5972 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.122116  5030 rpcz_store.cc:276] 0709 12:13:44.027467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.027600 (+   133us) service_pool.cc:224] Handling call
0709 12:13:45.121033 (+1093433us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:45.121227 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.121397 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.121420 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.121459 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:45.121485 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.121535 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.121632 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36889856}
I20260709 12:13:45.123574  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.124205  5972 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.124423  5024 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:45.124810  5805 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.125875  5851 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.088595  5859 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:45.172482  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.128022  4506 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:45.129729  5941 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.139277  5798 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.151651  5806 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.149875  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.159789  4330 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:45.161124  5939 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.084046  5816 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:45.172277  6012 log.cc:927] Time spent T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:45.126448  5935 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.170037  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.200393  4513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47840 (request call id 1499) took 1037 ms. Trace:
I20260709 12:13:45.200816  4513 rpcz_store.cc:276] 0709 12:13:44.162885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.183498 (+ 20613us) service_pool.cc:224] Handling call
0709 12:13:45.169831 (+986333us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5800054f98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:13:45.200317 (+ 30486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155126656}
I20260709 12:13:45.092284  5839 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:45.173194  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 366616us
I20260709 12:13:45.184996  5588 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.202337  5588 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.149566  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 424680us
I20260709 12:13:45.150671  6018 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.202780  5588 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.098403  5937 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.161728  5818 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.190152  5805 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.187898  6025 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.191560  4506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 1018) took 1046 ms. Trace:
I20260709 12:13:45.197180  4263 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45302 (request call id 274) took 4330 ms. Trace:
I20260709 12:13:45.205646  4479 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.233389  5588 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.234017  5588 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.180915  5859 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.212533  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.227298  4439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1087) took 1028 ms. Trace:
I20260709 12:13:45.239264  5588 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.229518  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 82654.1us
W20260709 12:13:45.230679  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.238025  5937 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:45.244299  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.202807  5839 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.239548  4439 rpcz_store.cc:276] 0709 12:13:44.198735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.258805 (+ 60070us) service_pool.cc:224] Handling call
0709 12:13:44.259263 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.352575 (+ 93312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.352642 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.425133 (+ 72491us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.944140 (+519007us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:44.944187 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.944275 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.226721 (+282446us) raft_consensus.cc:1685] finished
0709 12:13:45.226749 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.226944 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11979,"raft.queue_time_us":92819,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":48099,"thread_start_us":398281,"threads_started":1,"wal-append.queue_time_us":597605}
I20260709 12:13:45.251191  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.251588  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.252022  4513 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:45.252512  4515 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:45.254210  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.288766  4437 raft_consensus.cc:1240] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.275905  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:45.291975  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.292531  4439 raft_consensus.cc:2393] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:45.295624  4515 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:45.199690  5806 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.317282  5588 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.209120  5939 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.244801  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.290894  5822 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.207288  5816 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.211438  5856 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:13:45.210516  5935 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.244704  5863 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.258627  6010 raft_consensus.cc:476] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:13:45.330293  5588 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.258072  5839 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.288789  6006 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:45.344409  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 253212us
I20260709 12:13:45.232141  4263 rpcz_store.cc:276] 0709 12:13:40.866574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.893451 (+ 26877us) service_pool.cc:224] Handling call
0709 12:13:45.197109 (+4303658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:43.847585 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:43.848251 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:43.848289 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:13:43.848305 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:43.848639 (+   334us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:43.848724 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:43.848754 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:43.848932 (+   178us) tablet.cc:701] Row locks acquired
0709 12:13:43.848949 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:43.849091 (+   142us) write_op.cc:270] Start()
0709 12:13:43.849210 (+   119us) write_op.cc:276] Timestamp: P: 1783599223849048 usec, L: 0
0709 12:13:43.849236 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:43.849881 (+   645us) log.cc:844] Serialized 533 byte log entry
0709 12:13:44.409008 (+559127us) op_driver.cc:464] REPLICATION: finished
0709 12:13:44.955561 (+546553us) write_op.cc:301] APPLY: starting
0709 12:13:44.967686 (+ 12125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:44.984747 (+ 17061us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:44.995397 (+ 10650us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:44.995661 (+   264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:44.995837 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:44.995890 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:44.996095 (+   205us) log.cc:844] Serialized 23 byte log entry
0709 12:13:44.996290 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:44.996375 (+    85us) write_op.cc:454] Released schema lock
0709 12:13:44.996416 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:44.996786 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:44.996818 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":648865,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":503526,"apply.run_cpu_time_us":2115,"apply.run_wall_time_us":52621,"num_ops":1,"prepare.queue_time_us":54828,"prepare.run_cpu_time_us":2659,"prepare.run_wall_time_us":2659,"replication_time_us":518929,"thread_start_us":382149,"threads_started":2}]]}
I20260709 12:13:45.213266  6018 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.232400  5818 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.369616  4441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1090) took 1117 ms. Trace:
I20260709 12:13:45.323343  5798 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.364312  5588 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.349243  5964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.015s	sys 0.022s
I20260709 12:13:45.343987  5903 raft_consensus.cc:697] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:45.374034  4405 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:45.370229  4441 rpcz_store.cc:276] 0709 12:13:44.251736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.627064 (+375328us) service_pool.cc:224] Handling call
0709 12:13:44.627362 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.627543 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:44.984935 (+357392us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.369137 (+384202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.369213 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:45.369274 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.369373 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.369535 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15107,"prepare.queue_time_us":537269,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1502,"thread_start_us":725479,"threads_started":2}
I20260709 12:13:45.375896  4406 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:45.367556  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 132819us
I20260709 12:13:45.245704  6025 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.231858  4506 rpcz_store.cc:276] 0709 12:13:44.144773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.149644 (+  4871us) service_pool.cc:224] Handling call
0709 12:13:45.127479 (+977835us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5800054f98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:45.127675 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.185782 (+ 58107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.191499 (+  5717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154037504}
W20260709 12:13:45.382526  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 170078us
I20260709 12:13:45.355896  5867 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.385329  5588 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:45.386133  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 218564us
I20260709 12:13:45.387101  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:45.360642  5863 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:45.346517  5963 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:13:45.381383  5964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.015s	sys 0.022s
W20260709 12:13:45.390241  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.369804  5972 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.383283  6019 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.399518  5588 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.400497  5588 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.400839  5588 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.351002  5822 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:45.402019  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 349626us
W20260709 12:13:45.403519  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.408874  4439 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:45.392949  5863 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.412019  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.412792  4439 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:45.415367  6042 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:45.378628  5798 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.419943  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46465.7us
I20260709 12:13:45.374341  6006 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.408876  5851 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.420385  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:45.423273  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:45.420763  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.420902  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.404546  6036 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.421949  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.424005  4438 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.423734  4440 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.406977  6031 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.424347  4439 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:45.379104  6027 consensus_queue.cc:1059] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:13:45.422614  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:45.439165  4436 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.435292  4437 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:45.444628  5588 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:45.444502  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:45.441110  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:45.445659  4435 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.416206  5964 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.403967  5972 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.415722  6046 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.454344  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 80396.8us
I20260709 12:13:45.425624  5806 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.462260  4440 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:13:45.462626  4435 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:45.465473  4436 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:45.466240  5588 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.447240  6041 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.477617  4438 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:45.424402  5903 consensus_queue.cc:237] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.468045  4434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1094) took 1215 ms. Trace:
W20260709 12:13:45.479265  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.479329  4434 rpcz_store.cc:276] 0709 12:13:44.252873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.694459 (+441586us) service_pool.cc:224] Handling call
0709 12:13:44.694837 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.695282 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.695311 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.714186 (+ 18875us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.202913 (+488727us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:45.202973 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.203101 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.467808 (+264707us) raft_consensus.cc:1685] finished
0709 12:13:45.467833 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.467983 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202304,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":36496,"thread_start_us":416569,"threads_started":1,"wal-append.queue_time_us":640758}
I20260709 12:13:45.404654  6019 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.447913  6047 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:45.507652  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:45.508021  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.508417  4434 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.509214  4438 raft_consensus.cc:2410] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:45.483992  5806 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.485255  6031 raft_consensus.cc:697] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:45.496508  6021 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.542524  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 101489us
I20260709 12:13:45.419857  6042 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.544338  4406 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:45.547302  4434 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:13:45.514055  5806 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.551024  5822 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.551777  5817 raft_consensus.cc:3055] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.552292  5806 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.553381  5818 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.555539  6042 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.543783  6033 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.506476  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.552357  5935 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.506975  5963 raft_consensus.cc:3055] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:45.514798  5939 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.506917  5995 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:45.559358  4406 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.538064  5816 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:45.590622  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.552176  5817 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.595373  5903 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.595171  6031 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.595907  5903 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:45.598121  5903 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.598652  5903 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:45.577517  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.627576  5798 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:45.627993  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 50591us
I20260709 12:13:45.628664  6040 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.629081  6040 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.628962  4406 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.632743  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.627633  5903 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.634456  6052 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.635093  6052 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:45.635668  6052 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.574301  6044 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.569880  6025 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.551115  6021 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.589744  6048 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:45.639503  6048 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.640754  6021 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:45.599241  6032 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:13:45.439334  6036 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.600008  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.601320  4357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 156) took 1745 ms. Trace:
I20260709 12:13:45.575057  5963 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.645753  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.646385  6034 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.646672  5963 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.646914  6034 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.647588  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.607097  5995 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.591959  5872 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.557037  6050 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:13:45.464737  6046 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:45.613919  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.616997  4436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:45.645296  4357 rpcz_store.cc:276] 0709 12:13:43.856136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.856252 (+   116us) service_pool.cc:224] Handling call
0709 12:13:43.856601 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:43.929440 (+ 72839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.929477 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:43.930118 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 12:13:44.700443 (+770325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:45.027420 (+326977us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.067825 (+ 40405us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.352442 (+284617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.576832 (+224390us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b5400128ed4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:45.576878 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.601066 (+ 24188us) raft_consensus.cc:1685] finished
0709 12:13:45.601090 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.601256 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30926,"prepare.queue_time_us":767330,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":112,"raft.queue_time_us":67612,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":3184,"spinlock_wait_cycles":154781568,"thread_start_us":1354377,"threads_started":3,"wal-append.queue_time_us":957728}
I20260709 12:13:45.664744  4436 raft_consensus.cc:606] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:45.665171  4436 raft_consensus.cc:614] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:45.505805  6047 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.617777  5935 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.619460  6006 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.624292  6019 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.635219  5903 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.608688  5972 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.642452  6048 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.522658  5964 raft_consensus.cc:697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.654976  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:45.656320  4405 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:45.657656  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 153177us
I20260709 12:13:45.705523  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:45.661187  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.661459  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.707181  4515 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:45.662366  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.663687  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:45.708613  4514 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.681905  5995 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.681804  6028 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:45.672401  5935 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.679803  5941 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.663714  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 276712us
I20260709 12:13:45.667136  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.690562  6034 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.629626  6040 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.709633  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.717475  4507 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:45.669286  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:45.670181  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 266164us
I20260709 12:13:45.719337  4510 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:45.709913  4441 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:45.722906  6043 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:45.648028  5963 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:45.683900  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.666133  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.715925  4406 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.634469  5859 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.667958  5863 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:45.865728  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 144289us
I20260709 12:13:45.875218  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:45.864141  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 148719us
I20260709 12:13:45.876025  4513 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:45.762576  4514 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:45.871990  4511 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:13:45.866385  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 150539us
W20260709 12:13:45.739087  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 82823.3us
W20260709 12:13:45.878662  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.878916  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.880951  4511 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:45.881615  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.884191  6034 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.884709  6034 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.886718  6034 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:45.889808  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.893927  4406 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.894780  4406 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:45.895486  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.690554  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.897003  4481 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:45.888129  5846 consensus_meta.cc:287] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.774s	user 0.015s	sys 0.005s
W20260709 12:13:45.953270  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 58530.5us
I20260709 12:13:45.711583  6036 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.954241  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.712569  5941 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:45.782817  5964 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.973412  5941 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.959213  5903 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:45.974085  5903 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.963404  5872 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:45.975394  5872 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:45.975858  5872 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:45.976531  5839 consensus_meta.cc:287] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.602s	user 0.000s	sys 0.009s
I20260709 12:13:45.977023  5839 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.971298  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 74371.8us
I20260709 12:13:45.739097  5817 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.980005  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.981144  5941 raft_consensus.cc:2764] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:13:45.980983  6052 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.981781  5941 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.981840  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:45.983402  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.984961  6042 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.985555  6042 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.985953  6042 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.986735  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:45.987550  4515 raft_consensus.cc:2393] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:45.989562  5939 consensus_queue.cc:1059] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.990631  6027 raft_consensus.cc:3055] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.991117  6027 raft_consensus.cc:740] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.983150  5941 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:45.992326  5941 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:45.992082  6027 consensus_queue.cc:260] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:45.962536  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 76433.5us
I20260709 12:13:45.993543  6027 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.995301  6018 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.997668  6042 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.993316  5941 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.711465  5853 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.963995  4406 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.964763  6021 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.965350  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.001348  4506 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:45.966620  5859 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.002242  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:45.966946  5863 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.002611  4406 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.003523  4406 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.004629  4406 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:46.004869  5907 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.005304  5907 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.005645  5907 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.714636  6046 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:45.711792  6028 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.007301  5961 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:46.007566  5030 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:45.898191  4332 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:45.711951  5935 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:46.008385  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 110263us
I20260709 12:13:45.933271  6040 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:45.968474  4508 raft_consensus.cc:1240] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.765143  6048 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.971220  4362 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:13:46.009640  4362 pending_rounds.cc:85] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 5
I20260709 12:13:45.953419  6050 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.009891  4362 pending_rounds.cc:107] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:46.009877  6048 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.010514  4362 raft_consensus.cc:2889] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.010619  6048 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.011139  6048 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.011538  5853 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.013787  4406 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.976454  5903 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:45.879699  5995 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.960053  6025 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:45.963757  5816 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:45.781821  6047 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.007843  5961 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:45.887696  6031 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.020238  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:45.893824  5962 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.969321  6034 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.894021  5865 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.011929  5853 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.024278  5940 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.024230  6025 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.010087  6050 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.028313  6052 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.034345  6031 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.025521  5995 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.041931  6025 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.044457  6031 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:45.959242  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 61907.7us
I20260709 12:13:46.009069  4332 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:13:45.899178  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.021392  4479 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:45.984942  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.020107  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.027384  5816 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.024680  5839 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.054085  6040 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.038436  5853 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.114141  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.183328  5816 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.183902  4506 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:46.101505  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 87595.6us
I20260709 12:13:46.052744  6050 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.190465  5849 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.129673  5588 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.194813  5588 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:46.130424  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.107990  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.197856  5588 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.191130  5849 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.053210  6028 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.205206  6036 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.206131  6036 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.207532  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 198414us
I20260709 12:13:46.209053  4332 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:46.211247  6058 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:46.211376  5798 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:46.212327  6058 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:46.212595  5798 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.053730  6042 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.217859  5805 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.214239  6058 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.218766  4332 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:46.215803  5849 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.218726  5805 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.216334  5806 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.209895  6036 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.231805  6057 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.235500  6040 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.246145  6057 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.246249  6040 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.247179  5817 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.248977  6057 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.235795  4515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:46.162253  5961 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:13:46.239146  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 532790us
I20260709 12:13:46.239638  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.245604  5025 raft_consensus.cc:2410] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:46.230002  5806 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.252048  6040 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.252946  6027 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.253500  6027 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:46.255867  6027 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.256409  6050 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.257042  6050 raft_consensus.cc:697] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:46.256970  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:46.252900  4332 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:46.254835  4515 raft_consensus.cc:606] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:46.261359  4515 raft_consensus.cc:614] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:46.253260  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 268255us
I20260709 12:13:46.259848  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:46.267506  5023 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
I20260709 12:13:46.267849  5805 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.268816  4508 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:46.269767  6042 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.266711  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.270496  6042 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.253734  5806 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.272696  5995 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.282766  4506 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.258495  6050 consensus_queue.cc:237] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.302234  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.283470  4331 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:46.259758  5872 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.287292  5798 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.287729  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:46.309561  5872 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.058215  6048 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.311193  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.312422  6052 consensus_queue.cc:1059] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:46.313129  6048 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.314049  6052 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.314313  5903 raft_consensus.cc:3055] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.314939  5903 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:46.315441  6017 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.316262  6017 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.316336  5903 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.318070  5903 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.318434  6042 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.321714  6025 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:46.323315  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 69770.3us
I20260709 12:13:46.323876  5995 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:46.329492  4432 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:46.331097  5028 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:46.314664  6052 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:46.332850  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.335403  6033 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.336119  5940 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.337393  4509 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:46.318764  6017 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.402688  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.403277  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.403126  4406 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.403990  4438 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:46.404469  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.338346  5798 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.405694  5798 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:46.407027  5798 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.409549  5935 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.341823  4506 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:46.348372  5806 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.412750  5935 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.413411  5806 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:46.265633  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 176635us
I20260709 12:13:46.413913  6033 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.415194  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.342058  5816 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.417318  6033 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.419688  5816 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.362511  5854 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.420675  5854 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.368929  4432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1643) took 2217 ms (client timeout 1667 ms). Trace:
I20260709 12:13:46.379976  6031 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.423188  4432 rpcz_store.cc:269] 0709 12:13:44.151396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.152794 (+  1398us) service_pool.cc:224] Handling call
0709 12:13:46.368563 (+2215769us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54002c5954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:46.368812 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4938672512}
I20260709 12:13:46.424888  6031 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.383486  5588 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.425803  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.426666  4509 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:46.427204  5588 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.428069  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.428658  6041 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.429409  6041 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.338116  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 85479.4us
I20260709 12:13:46.404558  6017 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:46.394169  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.445827  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.359555  5995 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.447669  4515 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:46.448120  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 145476us
I20260709 12:13:46.449607  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:46.449904  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.439031  6017 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.398332  5853 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.450857  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.452337  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.464171  4509 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.453325  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.453629  4511 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:13:46.454493  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.360854  6052 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.458164  5995 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.462272  4506 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:46.460520  6017 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.466194  4511 pending_rounds.cc:85] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 4
I20260709 12:13:46.474658  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:46.469009  4511 pending_rounds.cc:107] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:13:46.476689  4511 raft_consensus.cc:2889] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.480465  4513 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:46.483557  4514 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.485592  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.487715  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.476333  6031 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.489432  4508 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.491643  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.492666  4432 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:46.493132  4432 raft_consensus.cc:614] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:46.483696  5935 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.494352  5588 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.494869  5588 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:46.496208  5854 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.467890  5940 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.495977  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.475265  6033 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:13:46.504909  4406 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.506122  6041 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.490868  6031 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.509498  4515 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.495296  6057 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.511297  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.514767  4506 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:46.526454  4436 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:46.527581  4406 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.531291  5588 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.547590  5806 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.550838  5907 consensus_meta.cc:287] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.005s
I20260709 12:13:46.551326  5961 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:46.551680  5903 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.552194  5961 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.552433  5903 raft_consensus.cc:697] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:46.552923  5961 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.553678  5903 consensus_queue.cc:237] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.560602  4406 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.562642  5872 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:46.563964  4406 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.534677  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:46.571408  4406 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:46.563313  5872 raft_consensus.cc:697] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:46.516225  5935 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.580842  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.577682  5820 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.577983  6018 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.591024  5820 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.591651  5820 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.591542  5849 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.583524  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.576503  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.587045  6042 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:46.598693  4511 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:46.598727  4514 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:46.587569  6041 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:46.588032  5839 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.588425  5822 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.591209  6018 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:46.586481  4481 connection.cc:256] RPC call timeout handler was delayed by -1.5115236609997282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 12:13:46.594468  5849 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.597848  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.570128  6057 raft_consensus.cc:697] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:46.551326  5806 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.606344  4481 connection.cc:256] RPC call timeout handler was delayed by -1.4971236609999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 12:13:46.551429  5907 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:46.609669  4481 connection.cc:256] RPC call timeout handler was delayed by -1.4727679150000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:13:46.611914  4481 connection.cc:256] RPC call timeout handler was delayed by -1.3792499659998612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 12:13:46.612373  4481 connection.cc:256] RPC call timeout handler was delayed by -1.206423660999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:13:46.610085  4441 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
W20260709 12:13:46.610455  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 94256.4us
I20260709 12:13:46.618774  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:46.611364  5822 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.620085  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:46.620854  4438 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.621198  5822 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.621729  5806 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.604871  6041 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.625113  6041 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.626312  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.627221  4434 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:46.612557  5853 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.607190  6018 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.640017  4508 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:46.606622  6025 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:46.625349  6072 log.cc:927] Time spent T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:13:46.640667  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.649890  4441 raft_consensus.cc:2410] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:13:46.651098  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.652608  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:46.597889  5872 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.658025  5995 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.613394  5962 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:13:46.663336  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:46.606941  6042 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.664606  6050 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:46.665181  6050 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:46.666224  6042 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:46.666163  6050 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.670701  4434 raft_consensus.cc:2393] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:46.673408  4438 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:46.674613  4515 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:46.686975  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.688385  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.688724  4997 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:13:46.689677  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 57938.9us
I20260709 12:13:46.689878  6009 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.690300  6009 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.690632  6009 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.692188  4509 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
W20260709 12:13:46.692852  6076 log.cc:927] Time spent T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:13:46.690668  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.694341  4514 raft_consensus.cc:2393] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:46.683256  6017 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.704034  6009 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.706332  6009 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.705801  6017 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.708070  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:46.708832  4434 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.712105  5907 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.717012  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:46.720659  5022 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.733110  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.737301  4441 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:46.738852  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:46.747641  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.753448  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.753837  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:13:46.754197  6009 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.754482  4512 raft_consensus.cc:606] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:46.754885  4512 raft_consensus.cc:614] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:46.754770  6009 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.757983  4441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:46.758323  6009 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.758767  4441 raft_consensus.cc:606] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:46.759323  4441 raft_consensus.cc:614] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:46.759949  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.760951  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:46.761605  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.760998  4435 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:46.767736  6041 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:46.768337  6041 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.770368  6041 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:46.762573  4506 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:46.748793  5940 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.827833  4514 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
W20260709 12:13:46.816133  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 77014.3us
W20260709 12:13:46.824030  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.830508  4434 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:46.832921  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.835088  4441 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:46.836366  4515 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:46.841421  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.840132  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.779731  6027 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.845563  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:46.847210  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.848894  4997 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:46.843716  5935 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.854044  5995 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.857191  6009 raft_consensus.cc:2804] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:46.857697  6009 raft_consensus.cc:697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:46.858325  5022 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:46.849440  6018 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.860137  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 253) took 6176 ms. Trace:
I20260709 12:13:46.861430  6018 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.853366  4441 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:46.854876  4511 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:46.874171  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.863082  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:46.875151  4514 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.877202  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.878909  4512 raft_consensus.cc:2393] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:46.837893  6057 consensus_queue.cc:237] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.888027  5028 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Advancing to term 5
I20260709 12:13:46.883536  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:46.894210  5961 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.860594  4260 rpcz_store.cc:276] 0709 12:13:40.683817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.683993 (+   176us) service_pool.cc:224] Handling call
0709 12:13:46.859901 (+6175908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:45.371138 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:45.502722 (+131584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:45.506883 (+  4161us) write_op.cc:435] Acquired schema lock
0709 12:13:45.516020 (+  9137us) tablet.cc:662] Decoding operations
0709 12:13:45.593379 (+ 77359us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:45.634596 (+ 41217us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:45.634632 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:45.634833 (+   201us) tablet.cc:701] Row locks acquired
0709 12:13:45.634845 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:13:45.635030 (+   185us) write_op.cc:270] Start()
0709 12:13:45.635156 (+   126us) write_op.cc:276] Timestamp: P: 1783599225634962 usec, L: 0
0709 12:13:45.635175 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:13:45.635853 (+   678us) log.cc:844] Serialized 538 byte log entry
0709 12:13:45.964751 (+328898us) op_driver.cc:464] REPLICATION: finished
0709 12:13:46.293283 (+328532us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124afe30ac 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f1251b23ef0
0709 12:13:46.354709 (+ 61426us) write_op.cc:301] APPLY: starting
0709 12:13:46.354933 (+   224us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:46.447364 (+ 92431us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:46.459962 (+ 12598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:46.506684 (+ 46722us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:46.559316 (+ 52632us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:46.559386 (+    70us) write_op.cc:312] APPLY: finished
0709 12:13:46.559821 (+   435us) log.cc:844] Serialized 23 byte log entry
0709 12:13:46.560070 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:46.560184 (+   114us) write_op.cc:454] Released schema lock
0709 12:13:46.560237 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:46.560693 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:46.560721 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":717155,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":388768,"apply.run_cpu_time_us":3287,"apply.run_wall_time_us":206209,"num_ops":1,"prepare.queue_time_us":652187,"prepare.run_cpu_time_us":4157,"prepare.run_wall_time_us":282432,"replication_time_us":329411,"spinlock_wait_cycles":7914368,"thread_start_us":854537,"threads_started":2}]]}
I20260709 12:13:46.897369  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.899132  6027 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:46.900470  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.858582  6009 consensus_queue.cc:237] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:46.867834  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.918692  4513 raft_consensus.cc:2393] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:46.926015  4515 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.935034  5856 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:46.939862  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:46.935563  4405 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:46.911536  6052 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:46.954968  6052 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.955961  6031 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:46.956427  4506 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:46.957669  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.958472  5028 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:46.959084  4437 raft_consensus.cc:2393] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:46.926097  6042 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.959275  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 45084.2us
I20260709 12:13:46.963304  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:46.965955  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.973608  4508 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:46.960721  4432 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:46.962298  4481 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:46.965315  4514 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:46.976831  4435 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:46.979318  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.965413  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.980180  4514 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.980616  4513 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:46.962575  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.983366  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.983867  4509 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:46.984083  4513 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:46.984411  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.984843  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.985157  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.985517  4509 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:46.985625  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.986248  6027 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.986514  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:46.960711  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:46.984084  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 54244.6us
I20260709 12:13:46.998839  4510 raft_consensus.cc:2393] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:46.981735  4406 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:46.987848  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 140855us
I20260709 12:13:46.996418  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.986320  4508 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.986828  4436 raft_consensus.cc:2393] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:46.985800  4513 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.958949  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:46.960914  6018 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.979868  6042 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.005074  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.042506  4510 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.005692  6052 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.005702  4481 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:47.002559  4509 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.006367  5820 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:47.017379  6078 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.449s	user 0.000s	sys 0.002s
I20260709 12:13:47.003475  4406 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.037707  4515 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
W20260709 12:13:47.058555  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55233.2us
I20260709 12:13:47.059288  4406 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:47.067471  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.069203  4406 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.049286  6018 raft_consensus.cc:697] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.048066  4506 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:47.058314  6052 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.083415  4406 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.050508  5962 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:13:47.087113  4406 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.073098  5854 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:47.088874  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 83333.8us
I20260709 12:13:47.089897  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.090277  5588 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.097072  5588 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:47.097401  5588 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.083442  5872 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.100773  5872 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.101723  5872 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.096755  4512 raft_consensus.cc:2393] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:47.107808  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.114486  6050 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:47.098038  5903 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.099642  6018 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.114961  4360 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.115948  4362 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:13:47.116794  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.116984  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.117784  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.117929  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.118898  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.141374  4510 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:47.120712  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.124486  4511 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:47.072365  6057 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:47.129148  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.153930  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.143913  4514 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:47.131968  5588 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.132480  6052 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:47.133430  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 46124.9us
I20260709 12:13:47.134812  5820 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:47.135757  6092 log.cc:927] Time spent T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:47.136096  5961 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.082166  5935 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.135317  4263 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:47.136914  4481 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:47.137902  6042 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:47.138391  5854 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.187541  5854 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.187779  6057 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.189884  6057 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:47.143623  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 52381.2us
I20260709 12:13:47.139631  5903 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.145093  5853 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.146643  4358 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:47.140631  4362 pending_rounds.cc:85] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 4
I20260709 12:13:47.147699  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.148236  4361 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:47.148627  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.149232  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.149312  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.150082  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.096344  5995 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:47.150768  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.152240  4508 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.152384  4512 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.156848  4513 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:47.172070  5588 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.179409  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.154920  4509 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:47.191141  5903 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:47.268325  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.386978  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 250159us
W20260709 12:13:47.387251  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.388341  4362 pending_rounds.cc:107] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:13:47.388790  4362 raft_consensus.cc:2889] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.177265  4263 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:47.387149  4438 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.389858  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.192556  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.390480  4508 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:47.361045  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.156587  5856 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.250558  4406 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:47.398752  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 148282us
I20260709 12:13:47.398857  5588 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.399634  5588 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.396651  4365 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:47.396713  4507 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:47.403646  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.386123  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.405571  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:47.409416  4512 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.411576  4364 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.412521  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.412674  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.413380  4364 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:47.413762  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:47.414306  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.355651  6041 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.420394  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.421136  4436 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:47.415959  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.422279  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.415634  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.415722  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.425067  4434 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:47.416445  4432 raft_consensus.cc:1240] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:47.414902  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:47.404577  4513 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:47.390733  4510 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.422272  4361 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:47.402951  4359 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:47.417212  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.443320  4437 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.443544  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.344177  6042 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.403189  5805 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.457116  4439 raft_consensus.cc:1240] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:47.457592  4441 raft_consensus.cc:1240] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.460186  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.467564  5588 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.479272  4508 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:47.463331  4440 raft_consensus.cc:2393] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 2: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:47.250926  5935 raft_consensus.cc:697] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.165087  6050 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.453913  4513 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:47.463981  6027 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.492743  5805 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.437615  5872 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:13:47.444643  6041 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.415627  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:47.546499  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.493777  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.430775  4263 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:47.553435  4432 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:13:47.463286  4509 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
W20260709 12:13:47.548939  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.556236  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.191555  4506 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:47.509231  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.551532  4512 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.560273  4263 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 3 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:47.570415  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 133451us
I20260709 12:13:47.401839  5853 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:47.572094  4364 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:47.574376  4435 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.406565  5995 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:47.578223  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 178289us
I20260709 12:13:47.581904  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:47.582759  4512 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.569572  4510 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:47.586812  4513 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.590879  4263 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:47.578418  4357 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:13:47.614029  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 67879.1us
I20260709 12:13:47.614480  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:47.618705  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:47.617967  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:47.508879  6095 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:13:47.617002  4406 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.562203  4507 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:47.619997  4263 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 3 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.627756  4434 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.614718  5820 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.631234  4436 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.562443  6027 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:47.637609  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 55697.4us
I20260709 12:13:47.639930  4263 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:47.641144  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 388904us
I20260709 12:13:47.644757  6041 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:47.645109  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:47.645864  6106 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:47.647809  4511 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.649071  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.655391  5820 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.650815  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.663690  4435 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:47.666085  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 49159.6us
I20260709 12:13:47.679759  4406 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.680430  6050 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:47.681656  6100 log.cc:927] Time spent T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:47.675086  6018 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.683915  4506 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:47.547374  5903 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.622581  6052 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.685307  4360 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:47.685642  6052 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.631083  5935 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.686497  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.680490  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:47.687991  6052 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.672806  4263 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.675946  4366 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.700786  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:47.703197  4360 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:47.703320  6041 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.704229  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.704587  4432 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:47.704911  4360 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.705400  5903 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.706064  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.702693  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:47.706841  4360 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:47.713132  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.711450  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.728039  4434 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:47.733035  4406 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.737756  4361 raft_consensus.cc:3060] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.741017  5588 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.741405  4406 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.741822  5588 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.742455  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.744580  4406 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:47.725152  6041 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.747035  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.724731  5961 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:47.724928  6018 raft_consensus.cc:697] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.751163  5907 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:47.749714  6109 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:13:47.751693  6041 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.744716  5854 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:47.748766  4360 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.767866  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:47.777664  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.782191  4436 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.792897  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.794641  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.760679  4437 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:47.782143  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.762085  4433 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.805132  4366 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:47.767419  5588 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.773538  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.816469  4357 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.792130  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.809670  4365 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:47.818171  4364 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:47.920261  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:47.886130  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.937041  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.942431  4361 raft_consensus.cc:2468] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:47.942617  4360 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:47.940580  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:47.785955  6031 raft_consensus.cc:1064] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:47.946661  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:47.947335  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.784904  6103 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:13:47.754869  5935 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:47.763587  6102 log.cc:927] Time spent T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:13:47.779714  6027 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:47.776849  6041 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:47.961045  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 203438us
I20260709 12:13:47.783910  5961 raft_consensus.cc:697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.781558  5820 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.786860  5854 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:47.789187  5995 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:47.795480  5853 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:47.795123  6009 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:47.762362  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:47.762429  6110 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.943717  6042 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.938272  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:47.983649  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:47.955319  6109 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:47.783679  6018 consensus_queue.cc:237] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:47.987926  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.133776  4515 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:48.136319  4514 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:48.078509  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 153691us
I20260709 12:13:48.129772  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.041185  5820 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:13:48.131494  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.132841  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.141120  4365 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:47.974381  5935 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:47.955539  5903 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.139828  4332 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:48.142272  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:47.978021  6031 raft_consensus.cc:1068] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Unable to promote non-voter 133eea4ce99644f5adbd12c985fc95cb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:47.999595  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.150403  4360 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:47.998137  4513 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:47.997005  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 229213us
I20260709 12:13:47.998610  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:48.152880  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 381848us
W20260709 12:13:48.159241  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.152617  4362 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:48.161453  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 1583) took 1013 ms. Trace:
I20260709 12:13:48.161814  4362 rpcz_store.cc:276] 0709 12:13:47.148040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.977484 (+829444us) service_pool.cc:224] Handling call
0709 12:13:48.161392 (+183908us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:48.098837  6115 log.cc:927] Time spent T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:13:47.981002  5856 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.168670  5903 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.169001  5856 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.169961  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.170814  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1465) took 1020 ms. Trace:
I20260709 12:13:48.144418  6009 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.171239  4363 rpcz_store.cc:276] 0709 12:13:47.150585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.144379 (+993794us) service_pool.cc:224] Handling call
0709 12:13:48.170744 (+ 26365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:48.162642  5961 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.172514  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.173345  4363 raft_consensus.cc:2393] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.173569  6009 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.174197  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.175302  4332 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:48.054267  6057 consensus_queue.cc:1059] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 12:13:48.103611  5865 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:48.143319  6110 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:48.091331  5023 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:48.142107  5805 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:48.181857  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.214331  4360 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:48.171401  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.177255  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.200209  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.216315  4359 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.207718  4332 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:48.179574  4363 raft_consensus.cc:2376] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5. Re-sending same reply.
I20260709 12:13:48.161211  5935 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.165073  4509 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:48.207105  4996 leader_election.cc:336] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.590s (SENT)
I20260709 12:13:48.222621  4996 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.164615  4507 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:48.167011  5028 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 1.
I20260709 12:13:48.230424  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:48.229003  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 250781us
I20260709 12:13:48.229288  4362 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.199666  5962 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.206274  5839 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.233167  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.202044  5907 raft_consensus.cc:697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:48.201637  6050 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.232410  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.208671  5865 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.235911  5856 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:48.237272  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.237442  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.238096  4359 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:48.238843  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.239957  4363 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.241890  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:48.241490  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 59481.4us
I20260709 12:13:48.246399  4362 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:48.210216  6031 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:48.245002  4360 raft_consensus.cc:2376] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4. Re-sending same reply.
I20260709 12:13:48.233426  5962 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.234922  5839 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.250831  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.251892  4359 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.239283  6124 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:48.181804  5854 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.261938  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.245927  5805 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.252480  5962 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.270004  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.272059  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.267695  5805 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.280511  4366 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:48.274935  6124 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:48.254142  5839 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:48.278945  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.270004  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.282900  4359 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.284122  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.284284  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.284508  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.145632  6109 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:48.295027  4996 leader_election.cc:336] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.528s (SENT)
I20260709 12:13:48.295643  4996 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.297857  6109 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:48.282840  5805 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.285246  4360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 1584) took 1136 ms. Trace:
I20260709 12:13:48.309886  4360 rpcz_store.cc:276] 0709 12:13:47.148345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.269958 (+1121613us) service_pool.cc:224] Handling call
0709 12:13:48.285166 (+ 15208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:48.311795  6052 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:48.312471  6052 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.281270  5872 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.316349  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.316216  5872 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.317066  4433 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:48.318559  5872 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.318272  5907 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.268326  6110 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:48.323907  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 44040.5us
I20260709 12:13:48.324750  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.325210  6127 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:48.325577  4434 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:48.258327  6050 consensus_queue.cc:1059] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:13:48.327937  6050 raft_consensus.cc:3055] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:48.328337  6050 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:48.329708  5806 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.329355  6050 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.330138  5806 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:48.337777  4357 consensus_meta.cc:287] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 12:13:48.338326  4357 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:13:48.286208  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 45328us
I20260709 12:13:48.341120  5588 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.326792  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:48.351348  4508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1554) took 1213 ms. Trace:
I20260709 12:13:48.314839  6052 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:48.330778  6050 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.356626  4997 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:48.349924  5588 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.363149  4997 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:48.366621  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.345093  5806 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.355602  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:48.373849  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:48.351934  4508 rpcz_store.cc:276] 0709 12:13:47.137944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.524602 (+386658us) service_pool.cc:224] Handling call
0709 12:13:47.551214 (+ 26612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:47.578631 (+ 27417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.578659 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:47.579094 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.671881 (+ 92787us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:48.141709 (+469828us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.201625 (+ 59916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.332104 (+130479us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400017054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:48.332151 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.332201 (+    50us) raft_consensus.cc:1685] finished
0709 12:13:48.351069 (+ 18868us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.351268 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":507944,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":2593,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":31690,"spinlock_wait_cycles":62270336,"thread_start_us":549650,"threads_started":3,"wal-append.queue_time_us":107081}
I20260709 12:13:48.355787  6130 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:48.364769  6057 consensus_queue.cc:1059] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:13:48.384788  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.385762  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36692 (request call id 1586) took 1236 ms. Trace:
I20260709 12:13:48.386096  4358 rpcz_store.cc:276] 0709 12:13:47.148864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.384478 (+1235614us) service_pool.cc:224] Handling call
0709 12:13:48.385680 (+  1202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:48.372088  5853 consensus_queue.cc:1059] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:13:48.387475  5806 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.379913  5588 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.377022  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:48.382750  6133 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.389964  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.390035  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.393996  4362 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.391322  4363 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:48.398702  6099 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.399292  6099 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:48.399720  6099 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.403065  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:48.404634  4434 raft_consensus.cc:2393] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.403065  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.406272  4366 raft_consensus.cc:2376] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4. Re-sending same reply.
I20260709 12:13:48.407356  5839 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.408290  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.413654  4359 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.414631  4362 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:48.415266  4359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 169) took 1203 ms. Trace:
I20260709 12:13:48.416055  4359 rpcz_store.cc:276] 0709 12:13:47.211881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.414304 (+1202423us) service_pool.cc:224] Handling call
0709 12:13:48.414653 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.414855 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.414887 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:48.414939 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:48.414979 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.415054 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.415177 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:48.418347  4359 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:48.393561  6133 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:48.419229  6133 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.419659  5839 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.409996  5853 consensus_queue.cc:1243] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:48.410393  6111 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:48.427536  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1585) took 1278 ms. Trace:
I20260709 12:13:48.427732  6111 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.411264  5865 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.409076  4358 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:48.460531  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.460930  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1468) took 1116 ms. Trace:
I20260709 12:13:48.461302  4358 rpcz_store.cc:276] 0709 12:13:47.344722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.386800 (+1042078us) service_pool.cc:224] Handling call
0709 12:13:48.460869 (+ 74069us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:48.419973  4996 leader_election.cc:336] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.695s (SENT)
I20260709 12:13:48.421967  5995 raft_consensus.cc:3055] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:48.478339  5995 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:48.478426  5903 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.393668  6126 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:48.479166  6126 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.479370  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.424252  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:48.426704  4407 leader_election.cc:336] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.744s (SENT)
I20260709 12:13:48.480160  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.480412  5025 raft_consensus.cc:2410] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:48.481142  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 54491us
I20260709 12:13:48.481863  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.426494  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.483660  4364 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:48.418777  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.443744  4359 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:48.444548  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.444813  4441 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.445035  4439 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.445405  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.444998  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.447996  6057 consensus_queue.cc:1059] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:48.493263  4358 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:48.450176  4332 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:48.450769  5853 consensus_queue.cc:1059] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.467129  5935 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.467806  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.496345  4357 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.468546  4996 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.473035  4506 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:48.474833  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.476711  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.498179  4508 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:48.479609  6126 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.427975  4363 rpcz_store.cc:276] 0709 12:13:47.148627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.394884 (+1246257us) service_pool.cc:224] Handling call
0709 12:13:48.395212 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.427181 (+ 31969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.427213 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:48.427258 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:48.427288 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.427347 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.427463 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:48.448772  5940 raft_consensus.cc:1064] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:13:48.505473  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.514580  4439 raft_consensus.cc:1240] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:48.516360  4510 raft_consensus.cc:1240] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:48.518112  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.524263  4357 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:48.525136  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.526475  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.527169  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.528599  4361 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.527176  4435 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:48.529239  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.529363  4358 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.534190  4437 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:48.534832  4438 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.535059  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:48.524995  5940 raft_consensus.cc:1068] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Unable to promote non-voter 133eea4ce99644f5adbd12c985fc95cb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:48.515713  5907 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.545977  4440 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:48.541738  5935 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.542761  6041 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:48.543296  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 123386us
I20260709 12:13:48.526897  5865 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:48.543771  6111 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:48.544483  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.552317  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.558743  4363 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:48.497926  5839 consensus_queue.cc:1059] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:13:48.556560  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.560555  6145 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:48.561136  6145 raft_consensus.cc:697] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:48.567691  6131 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 0.293s	user 0.004s	sys 0.002s
I20260709 12:13:48.567955  5025 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:48.562760  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 112666us
I20260709 12:13:48.563217  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.571048  4511 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:48.574479  5903 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:13:48.574790  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.577443  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.579335  4515 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:48.575520  4508 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.529934  5962 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.570031  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:48.585786  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:48.587165  6111 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:48.587684  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.565806  6130 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:48.588966  6130 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.592233  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.604600  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.605141  4364 raft_consensus.cc:3055] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:48.606503  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.607299  4515 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:48.586730  5935 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:48.605518  4364 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:48.577659  4509 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:48.614856  4441 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:48.616482  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:48.617125  4508 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.618939  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.612258  4364 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.620432  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:48.622032  4357 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:48.622767  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44785.9us
I20260709 12:13:48.593997  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:48.626012  4513 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.627589  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.628408  4512 raft_consensus.cc:2410] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:48.630244  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:48.630918  4437 raft_consensus.cc:2368] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3.
I20260709 12:13:48.555446  5995 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.614195  5935 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.632011  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.632531  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.632663  4331 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:48.633201  4435 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:48.635391  6130 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:48.636186  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.636778  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.637250  6120 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:13:48.636901  4514 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:48.641292  4358 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:48.632529  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:48.575893  6099 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.605756  5903 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:48.643994  4996 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.628782  6050 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:48.652014  4364 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.639249  6143 raft_consensus.cc:3055] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:48.642117  5935 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.634523  6133 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:48.665060  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 49674.9us
I20260709 12:13:48.667124  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.668259  5865 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:48.677551  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.679936  4514 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:48.682521  5588 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.685361  4406 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:48.674693  4407 leader_election.cc:336] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.119s (SENT)
I20260709 12:13:48.699419  4407 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.699827  5588 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:48.704752  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.662561  6143 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:48.707901  4406 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:48.708652  5588 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.717759  5022 raft_consensus.cc:2393] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 2: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:13:48.711545  6145 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:48.720597  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 96461.8us
W20260709 12:13:48.717761  4407 leader_election.cc:336] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.137s (SENT)
I20260709 12:13:48.726029  6151 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.728065  6123 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.736770  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.737905  4511 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:48.728215  6151 consensus_queue.cc:1059] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:13:48.739946  6151 consensus_queue.cc:1243] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:48.740614  6151 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.740334  6143 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.744036  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.744791  4513 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.746404  6133 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.747785  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.705211  5854 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.741158  6151 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:48.757954  6137 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.701737  5995 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.748898  5806 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:48.761855  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46370.4us
I20260709 12:13:48.694940  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.760366  4511 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.808876  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:48.704221  6050 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:48.817376  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.719997  6041 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:48.766681  5854 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.819278  4513 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:48.822203  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.807216  6143 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.803474  6151 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.797900  6137 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.827039  5854 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.835721  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.836766  4511 raft_consensus.cc:2368] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:48.839075  5023 raft_consensus.cc:1240] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:48.839406  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 121720us
W20260709 12:13:48.840070  4407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.177s (SENT) [suppressed 41 similar messages]
I20260709 12:13:48.840865  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.841527  4515 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:48.842394  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.842443  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.843036  4515 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.844849  6099 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.846113  4509 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:48.820982  5907 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.849900  5962 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:48.851019  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:48.854792  4360 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:48.855664  5995 raft_consensus.cc:3055] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:48.831797  6031 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:13:48.832496  5805 consensus_meta.cc:287] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:13:48.857520  4508 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:48.894520  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:48.895260  4508 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.837532  6137 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.861094  6126 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:48.864143  6147 log.cc:927] Time spent T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 12:13:48.868156  4511 raft_consensus.cc:1240] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:48.868412  6146 log.cc:927] Time spent T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 12:13:48.869617  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:48.870110  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:48.874614  6041 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.890244  5903 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:48.878296  5028 raft_consensus.cc:1240] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:48.930547  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 305092us
W20260709 12:13:48.885913  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 322822us
I20260709 12:13:48.887212  4364 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:13:48.890703  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:48.891342  4407 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:48.912258  4366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 167) took 1758 ms. Trace:
I20260709 12:13:48.931633  4437 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.933096  4364 pending_rounds.cc:85] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 1
I20260709 12:13:48.876953  4405 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:48.913254  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 261123us
I20260709 12:13:48.933871  4364 pending_rounds.cc:107] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:13:48.934372  4364 raft_consensus.cc:2889] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:48.935894  4511 raft_consensus.cc:1240] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:48.892807  5995 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:48.940157  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 55464.2us
I20260709 12:13:48.940737  4515 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:48.944489  4331 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:48.943531  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 66671.2us
I20260709 12:13:48.923750  6130 consensus_queue.cc:1059] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:13:48.932025  4366 rpcz_store.cc:276] 0709 12:13:47.153773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.407115 (+1253342us) service_pool.cc:224] Handling call
0709 12:13:48.407477 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.407738 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:48.527851 (+120113us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.911860 (+384009us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:48.911931 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:48.911989 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.912077 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.912195 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132637,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":144734,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":423440,"threads_started":3}
I20260709 12:13:48.958716  4508 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:13:48.962095  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.946694  6108 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:13:48.966231  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:48.967362  4437 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:48.971102  4508 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:48.889325  5907 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:48.930696  5903 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.960377  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:48.978513  4511 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.900540  5805 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:48.947394  6052 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.984351  5853 consensus_queue.cc:1243] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:13:48.988174  6149 log.cc:927] Time spent T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:48.992561  4365 raft_consensus.cc:2368] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
I20260709 12:13:48.992616  4509 raft_consensus.cc:1240] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:48.994810  4996 leader_election.cc:336] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.820s (SENT)
I20260709 12:13:48.951612  5962 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.982950  6099 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:49.011039  5962 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:48.995417  6027 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.011603  5962 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.011375  6099 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.011879  6027 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.013989  6027 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:49.014262  6099 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:49.015563  4996 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.947194  6050 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:48.999082  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 67565.7us
I20260709 12:13:48.938846  6041 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.015640  4407 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:48.983915  4507 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:49.018429  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:49.019352  4512 raft_consensus.cc:2410] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:48.983718  5903 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.014796  6027 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:49.032400  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.999198  6031 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.041771  4513 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:49.049928  4513 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:49.056674  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 61896.8us
I20260709 12:13:49.023761  6099 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.020385  6161 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:49.101573  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 86016us
W20260709 12:13:49.104856  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 48573.3us
I20260709 12:13:49.033468  6018 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:13:49.123028  6130 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:49.057796  6151 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:49.134013  4332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.019s
W20260709 12:13:49.157393  4332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.011s	sys 0.019s
W20260709 12:13:49.156921  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 196614us
W20260709 12:13:49.162868  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 534823us
I20260709 12:13:49.124056  5805 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.088296  5995 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:49.174715  6157 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:13:49.174911  5995 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.175957  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 177) took 1397 ms. Trace:
I20260709 12:13:49.176164  6169 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:49.176375  4362 rpcz_store.cc:276] 0709 12:13:47.778693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.417552 (+638859us) service_pool.cc:224] Handling call
0709 12:13:48.431840 (+ 14288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:48.540132 (+108292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.540154 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:48.566349 (+ 26195us) log.cc:844] Serialized 26 byte log entry
0709 12:13:48.960115 (+393766us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:48.960174 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.960266 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.175698 (+215432us) raft_consensus.cc:1685] finished
0709 12:13:49.175729 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.175889 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6815,"raft.queue_time_us":115342,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":402993,"threads_started":2,"wal-append.queue_time_us":507167}
I20260709 12:13:49.180043  6173 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:49.181181  4331 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:49.181073  5854 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.182328  6138 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:49.183633  5854 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.173308  6130 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.186553  5856 raft_consensus.cc:3055] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.188176  6130 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:49.188730  6152 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:13:49.190116  4331 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.191435  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:49.159401  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 193265us
I20260709 12:13:49.121136  5935 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.207580  4332 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:49.211467  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:49.191217  4997 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:13:49.215909  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 112559us
I20260709 12:13:49.176667  6169 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.221386  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:49.172307  6126 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.220055  4407 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.186924  5856 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
W20260709 12:13:49.233209  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.233781  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.234130  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.234834  5853 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:49.227174  6133 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:49.236229  5935 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.232308  6145 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.237031  5935 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:49.232565  5854 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.227151  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:49.236179  6133 raft_consensus.cc:697] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:49.239035  5856 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.206614  5805 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:49.158047  6027 consensus_queue.cc:1059] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:13:49.242748  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 52702.1us
I20260709 12:13:49.245338  4331 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:49.249868  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 90974.8us
I20260709 12:13:49.250041  4407 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:49.311616  4363 raft_consensus.cc:1275] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:13:49.305219  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.277928  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:49.329914  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.309381  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:49.313863  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:49.340973  6031 raft_consensus.cc:697] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:49.224318  6161 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.380892  4357 raft_consensus.cc:2376] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4. Re-sending same reply.
I20260709 12:13:49.225374  6169 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.385571  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:49.278512  6177 raft_consensus.cc:2764] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:49.395841  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:49.227754  6154 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:49.345438  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.403142  4997 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:49.303161  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 55571.2us
I20260709 12:13:49.251971  5856 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.244508  5805 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:49.232748  6057 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 12:13:49.309306  6041 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:49.328222  6143 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:49.396663  4362 raft_consensus.cc:2376] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4. Re-sending same reply.
I20260709 12:13:49.341667  6164 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:13:49.419701  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 88610.7us
I20260709 12:13:49.420652  4997 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:49.405448  6154 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:49.435119  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 189881us
I20260709 12:13:49.411155  5805 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.251223  5820 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 12:13:49.439988  6187 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:13:49.253559  6133 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.460399  4481 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:49.414181  6143 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.342298  6018 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:13:49.438727  6122 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 12:13:49.447346  6031 consensus_queue.cc:237] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.435515  5839 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.488776  5839 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:49.425081  6127 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:49.506059  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 70633.2us
W20260709 12:13:49.468664  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.386935  6178 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:13:49.473255  4331 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.421536  6164 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.467561  6099 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.479943  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:49.434398  5907 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:49.515138  5029 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:49.514624  6177 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:13:49.526379  6185 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:49.526759  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:49.528236  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:49.461620  6154 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.476073  5962 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.464588  6151 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.492872  6143 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:49.512514  6052 consensus_meta.cc:287] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.515s	user 0.000s	sys 0.010s
I20260709 12:13:49.535108  4481 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:49.519459  6099 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:49.554307  6099 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.538887  6145 consensus_queue.cc:1059] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:13:49.550343  6027 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:49.556550  6027 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.556944  6027 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:49.557845  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 307646us
I20260709 12:13:49.526398  6177 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
W20260709 12:13:49.570677  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 97520us
I20260709 12:13:49.571597  4331 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.571699  5022 raft_consensus.cc:1240] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.542454  6052 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.582901  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:49.583328  4996 leader_election.cc:336] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.912s (SENT)
W20260709 12:13:49.584264  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 261764us
I20260709 12:13:49.585307  4360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1495) took 1605 ms. Trace:
I20260709 12:13:49.585704  4360 rpcz_store.cc:276] 0709 12:13:47.979741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.444251 (+464510us) service_pool.cc:224] Handling call
0709 12:13:49.585082 (+1140831us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003557d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:49.585212 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830362496}
I20260709 12:13:49.564453  6041 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.600029  6156 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.600621  6179 raft_consensus.cc:2764] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:13:49.601028  6155 log.cc:927] Time spent T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 12:13:49.601362  6193 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:49.602377  6183 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:13:49.604948  4332 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:49.605651  5962 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:49.605598  5995 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:49.607442  6169 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.611435  6184 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.611562  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:49.649000  4433 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.608906  6177 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.609437  6174 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:49.609879  5903 consensus_meta.cc:287] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
W20260709 12:13:49.608879  6137 consensus_meta.cc:287] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.004s
I20260709 12:13:49.606963  6143 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.655412  5903 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.657285  6143 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:49.657147  6191 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:13:49.615622  4331 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.619474  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:49.620319  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:49.660125  5995 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:49.661396  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 45872.2us
I20260709 12:13:49.622653  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:49.623629  4436 raft_consensus.cc:1240] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.623980  4441 raft_consensus.cc:1217] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:49.662189  4331 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.643067  4434 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.581739  5853 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:49.645597  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 110874us
I20260709 12:13:49.651736  4513 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:49.654313  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 71030.8us
I20260709 12:13:49.658262  6191 raft_consensus.cc:3055] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.660269  4437 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 6: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:49.661885  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:49.662487  4441 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:49.634372  5805 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.663774  4331 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.644088  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:49.692374  4432 raft_consensus.cc:2368] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:49.692997  4331 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.692374  4515 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.621114  4438 raft_consensus.cc:1240] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:49.649586  6108 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.660817  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:49.681289  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.684124  6170 consensus_queue.cc:1048] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:49.702610  4437 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:13:49.684165  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:49.686859  6041 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:49.695299  4331 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.650735  6174 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.618788  6057 consensus_queue.cc:1059] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:13:49.671360  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:49.653717  6184 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.706079  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:49.724462  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 126681us
I20260709 12:13:49.705354  6192 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.647681  6099 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.677284  5995 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.674695  6191 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:49.727455  4996 leader_election.cc:336] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 2.008s (SENT)
I20260709 12:13:49.655416  6137 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:49.693723  6143 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.737560  6110 raft_consensus.cc:1064] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:13:49.727415  4515 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:49.719635  4507 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:49.732374  4509 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:49.758167  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 84035.2us
I20260709 12:13:49.719936  6174 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:49.774163  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 73226.6us
W20260709 12:13:49.814553  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 48074.3us
W20260709 12:13:49.811594  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 83143.6us
I20260709 12:13:49.819701  4331 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:49.776674  6167 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:49.824575  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 92784.8us
I20260709 12:13:49.840988  4359 raft_consensus.cc:3055] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.862047  4406 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:49.886961  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.841420  4359 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:49.768975  6108 consensus_queue.cc:1059] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.2, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:49.817896  5995 consensus_queue.cc:1059] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:13:49.817857  6143 consensus_queue.cc:1059] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:13:49.917150  4331 leader_election.cc:400] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:49.919464  4331 leader_election.cc:403] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:49.777033  6156 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 12:13:49.920203  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.922789  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 59319us
I20260709 12:13:49.841528  5907 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.820185  5820 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:13:49.896461  6195 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.933277  6212 consensus_queue.cc:1059] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:13:49.919853  6108 consensus_queue.cc:1243] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:49.935441  6118 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.935966  6143 consensus_queue.cc:1243] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:13:49.959468  6108 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
W20260709 12:13:49.989274  6211 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:13:49.990131  6184 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:49.993072  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 200165us
W20260709 12:13:49.994962  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 71351.9us
I20260709 12:13:50.000666  4508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1588) took 1132 ms. Trace:
W20260709 12:13:50.001250  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.014819  4508 rpcz_store.cc:276] 0709 12:13:48.868183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.982282 (+114099us) service_pool.cc:224] Handling call
0709 12:13:48.983639 (+  1357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.055902 (+ 72263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.055943 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.089591 (+ 33648us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.302183 (+212592us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:49.302241 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.000095 (+697854us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54000cf654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:50.000155 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.000222 (+    67us) raft_consensus.cc:1685] finished
0709 12:13:50.000243 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.000579 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3936,"raft.queue_time_us":56250,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5115,"spinlock_wait_cycles":165183872,"thread_start_us":182746,"threads_started":1,"wal-append.queue_time_us":272734}
I20260709 12:13:49.943873  5853 consensus_queue.cc:1059] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:13:49.915727  6041 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:49.957334  6195 raft_consensus.cc:697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:49.935614  5907 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.019326  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:50.027940  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:50.028954  4438 raft_consensus.cc:2368] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:50.017159  5805 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:50.031924  6201 log.cc:927] Time spent T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
W20260709 12:13:50.032495  5856 consensus_meta.cc:287] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.619s	user 0.017s	sys 0.001s
I20260709 12:13:50.014918  6170 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:50.040158  4438 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:50.016870  6057 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:13:50.046377  6197 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:13:50.029963  6099 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:50.054709  6203 log.cc:927] Time spent T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:13:50.064710  4433 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:50.055033  6108 consensus_queue.cc:1059] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:13:50.070659  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 212331us
I20260709 12:13:50.051196  6215 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.056277  6137 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.082566  5856 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:50.085213  5856 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:50.086290  6208 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.086807  6208 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:50.087000  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:50.054661  6216 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:50.091655  6209 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:13:50.045516  6170 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.087955  5856 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.054613  6027 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.061092  6207 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:13:50.049226  6057 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.089136  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:50.072049  5839 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.120316  4481 leader_election.cc:400] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3.
I20260709 12:13:50.120724  4481 leader_election.cc:403] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:13:50.123121  4996 leader_election.cc:336] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Timed out: RequestConsensusVote RPC to 127.3.34.195:46537 timed out after 1.872s (SENT)
I20260709 12:13:50.123601  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:50.100752  6215 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.132874  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:50.133574  6214 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3.
I20260709 12:13:50.166742  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.087920  6208 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.169592  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.170439  4508 raft_consensus.cc:2393] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:50.166759  5839 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.168587  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 45495.6us
W20260709 12:13:50.118112  6206 log.cc:927] Time spent T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260709 12:13:50.173947  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.119627  6212 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.175206  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.178731  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.200500  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.201450  4510 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:50.202562  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.211568  4433 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:50.208431  4510 raft_consensus.cc:2368] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3.
I20260709 12:13:50.176599  6208 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.172435  5856 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.228240  6218 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.228470  4996 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:50.229743  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.233188  4363 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.234930  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 215115us
W20260709 12:13:50.237421  6186 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:50.101033  6216 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.217170  6099 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:50.094901  6195 consensus_queue.cc:237] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.231717  5856 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.256493  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.206911  6225 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.261029  4331 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:50.246686  6199 log.cc:927] Time spent T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:13:50.177546  6215 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.262948  5025 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
W20260709 12:13:50.251196  6204 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:13:50.276322  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.277621  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.277695  6216 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.278512  6216 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.280104  6057 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:50.285017  4433 raft_consensus.cc:1217] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:50.285724  4433 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:50.288228  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.288632  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:50.289386  6057 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.290580  4331 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:50.291329  6057 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.292804  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.293408  6173 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:50.293970  6173 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.294514  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.295221  4360 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:50.296128  6175 raft_consensus.cc:3055] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.296545  6175 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:50.297385  6175 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.250255  5907 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.263422  5856 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.299950  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.301762  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:50.301890  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:50.302409  6154 consensus_meta.cc:287] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.002s
I20260709 12:13:50.303056  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:50.303695  4360 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.304134  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:50.304888  4435 raft_consensus.cc:2368] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3.
I20260709 12:13:50.298882  4512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1591) took 1425 ms. Trace:
I20260709 12:13:50.298719  6175 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.308838  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.309892  4508 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:50.310719  4515 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:50.305665  4512 rpcz_store.cc:276] 0709 12:13:48.872983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.034711 (+161728us) service_pool.cc:224] Handling call
0709 12:13:49.036312 (+  1601us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:49.052002 (+ 15690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.052042 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:49.056974 (+  4932us) log.cc:844] Serialized 52 byte log entry
0709 12:13:49.551229 (+494255us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:49.551295 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.551396 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.298599 (+747203us) raft_consensus.cc:1685] finished
0709 12:13:50.298622 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.298795 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70863,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6287,"spinlock_wait_cycles":1272704,"thread_start_us":433642,"threads_started":1,"wal-append.queue_time_us":663661}
I20260709 12:13:50.313601  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:50.315821  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.316380  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.316636  4366 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:50.317195  4357 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
W20260709 12:13:50.322086  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.328759  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.329775  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.331197  4357 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:50.330914  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.271435  6207 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:50.321462  4365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1500) took 2202 ms (client timeout 1916 ms). Trace:
I20260709 12:13:50.331905  4366 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:50.334632  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.335772  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:50.340764  4435 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:50.340740  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.341727  4358 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
W20260709 12:13:50.338094  4365 rpcz_store.cc:269] 0709 12:13:48.119510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.257999 (+138489us) service_pool.cc:224] Handling call
0709 12:13:50.318469 (+2060470us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54003552d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:50.321377 (+  2908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638464640}
I20260709 12:13:50.346500  4366 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:50.259104  6099 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.357161  5805 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.361599  4435 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:13:50.374801  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.264433  6218 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.302824  6154 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.400470  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:50.401280  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 172907us
I20260709 12:13:50.410308  5907 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:50.353834  6207 raft_consensus.cc:697] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:50.412074  6154 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:50.390612  5805 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.413300  6027 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:50.413731  6148 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:13:50.414033  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:50.420255  4364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1509) took 1958 ms. Trace:
I20260709 12:13:50.444485  4364 rpcz_store.cc:276] 0709 12:13:48.441074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.484610 (+ 43536us) service_pool.cc:224] Handling call
0709 12:13:48.525303 (+ 40693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:48.939373 (+414070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.399545 (+1460172us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b540005d554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:50.399790 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183303424}
I20260709 12:13:50.358589  4363 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:50.421973  4996 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:50.423629  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.450150  4357 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:50.446132  5907 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.453392  5856 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.453444  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:50.490198  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 254690us
W20260709 12:13:50.618932  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.829010  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.828904  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 370558us
W20260709 12:13:50.830122  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 408199us
I20260709 12:13:50.837780  4513 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:50.837985  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.840035  4513 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.840164  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.844208  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.845343  4508 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:13:50.845752  4508 pending_rounds.cc:85] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 2
I20260709 12:13:50.846009  4508 pending_rounds.cc:107] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:13:50.845815  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.846395  4508 raft_consensus.cc:2889] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:50.847103  4513 raft_consensus.cc:2368] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:50.847726  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.848114  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.849179  4513 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:50.855257  4508 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.837749  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:50.836347  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:50.672729  6127 consensus_meta.cc:287] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 1.161s	user 0.012s	sys 0.000s
W20260709 12:13:50.487068  4509 consensus_meta.cc:287] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.004s
W20260709 12:13:50.911764  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.904273  4508 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:50.904949  4512 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:13:50.801956  5839 consensus_meta.cc:287] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.004s
I20260709 12:13:50.908004  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.927341  4366 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:50.493691  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:13:50.835428  6174 consensus_meta.cc:287] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 1.019s	user 0.013s	sys 0.000s
W20260709 12:13:50.745781  6228 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.666s	user 0.005s	sys 0.000s
I20260709 12:13:50.543289  6099 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.931331  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.932436  4364 raft_consensus.cc:2376] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5. Re-sending same reply.
I20260709 12:13:50.931242  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.932734  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.566905  6126 raft_consensus.cc:3055] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.643786  6207 consensus_queue.cc:237] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.933315  4365 raft_consensus.cc:2376] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3. Re-sending same reply.
I20260709 12:13:50.835323  5805 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:50.944552  4481 connection.cc:256] RPC call timeout handler was delayed by -1.6231182500000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.246s for a response
I20260709 12:13:50.945266  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.524389  6050 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.483556  5820 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.835656  6218 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.835168  6241 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.715296  6161 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.921778  5856 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:50.552188  6179 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:50.526177  6027 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:50.964169  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.966739  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.937427  6126 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:50.458330  6123 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:50.928972  4509 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:13:50.972260  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.988062  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.972700  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.980206  4432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37854 (request call id 1151) took 1358 ms. Trace:
I20260709 12:13:50.995152  4364 raft_consensus.cc:2368] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
I20260709 12:13:50.993666  4363 raft_consensus.cc:2393] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:50.992075  4511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.022s	sys 0.029s
W20260709 12:13:50.996867  4511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.022s	sys 0.029s
I20260709 12:13:50.995599  4432 rpcz_store.cc:276] 0709 12:13:49.621661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.622380 (+   719us) service_pool.cc:224] Handling call
0709 12:13:50.980004 (+1357624us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54000735d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:50.980127 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41783552}
W20260709 12:13:50.973666  4481 connection.cc:256] RPC call timeout handler was delayed by -1.3612182500000927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2751s for a response
I20260709 12:13:50.935554  6174 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:50.864006  5907 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:50.987600  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:50.937023  6127 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.996867  4997 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:13:50.997692  4481 connection.cc:256] RPC call timeout handler was delayed by -1.2019182500000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2928s for a response
W20260709 12:13:50.998416  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 167049us
I20260709 12:13:50.991576  4365 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:51.000239  4331 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:50.979115  6131 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 1.369s	user 0.009s	sys 0.004s
I20260709 12:13:51.014354  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.027549  6255 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:50.943925  4506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1606) took 1263 ms. Trace:
I20260709 12:13:50.944139  5940 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:50.982666  6215 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:50.994870  6179 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:50.963655  6050 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.045763  4440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1155) took 1421 ms. Trace:
I20260709 12:13:51.051656  4366 raft_consensus.cc:2376] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3. Re-sending same reply.
I20260709 12:13:51.054515  6179 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.034492  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:50.963742  5820 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.059221  5820 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.030762  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:51.037454  4514 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.037698  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.061169  6205 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:51.061461  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.061712  6205 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.062211  4363 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:51.062402  6217 raft_consensus.cc:2764] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:51.035717  4506 rpcz_store.cc:276] 0709 12:13:49.678395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.689887 (+ 11492us) service_pool.cc:224] Handling call
0709 12:13:49.735240 (+ 45353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.171288 (+436048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.173857 (+  2569us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.255430 (+ 81573us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.829870 (+574440us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:50.864337 (+ 34467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.900824 (+ 36487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.925637 (+ 24813us) raft_consensus.cc:1685] finished
0709 12:13:50.925673 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.941147 (+ 15474us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161498,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":642378,"threads_started":2,"wal-append.queue_time_us":578086}
I20260709 12:13:51.055173  6126 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.045161  6174 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.070557  6215 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:51.049219  4440 rpcz_store.cc:276] 0709 12:13:49.624337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.624479 (+   142us) service_pool.cc:224] Handling call
0709 12:13:49.624935 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.639328 (+ 14393us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:49.639367 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.950226 (+310859us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b2c00000238. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124c9e6a11 00007f124c9f6372 00007f124e128a01 00007f124e0ed43a 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2
0709 12:13:49.957026 (+  6800us) log.cc:844] Serialized 26 byte log entry
0709 12:13:49.994712 (+ 37686us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:49.994751 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.994817 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.707786 (+712969us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b24002a8108. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124ae869c4 00007f124ae84acb 00007f124b03fdc9 00007f124b03fa55 00007f124b03f09d 00007f124dc7110e 00007f124dc8888c 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221
0709 12:13:51.045404 (+337618us) raft_consensus.cc:1685] finished
0709 12:13:51.045438 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:51.045626 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13879,"raft.queue_time_us":31227,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"spinlock_wait_cycles":40670720,"thread_start_us":37239,"threads_started":1,"wal-append.queue_time_us":122457}
I20260709 12:13:51.071728  4506 raft_consensus.cc:1217] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:51.056484  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.072376  4506 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:51.063077  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.073840  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.014451  4509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47840 (request call id 1599) took 1355 ms. Trace:
I20260709 12:13:50.995388  6027 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.065521  5940 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.083102  5940 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.083846  4507 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:13:51.085070  6099 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.085651  6099 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.087874  6099 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.088245  6205 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.067883  5023 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.090529  5820 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.067415  5856 consensus_queue.cc:1059] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:13:51.091045  5820 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.091796  5856 raft_consensus.cc:3055] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.092213  5856 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:51.093226  5820 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.093114  5856 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.093791  5820 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:51.094331  5820 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.095923  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.063972  6145 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:13:51.099315  4406 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:51.074468  6235 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:13:51.026597  4364 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:51.050614  6050 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.070643  4331 leader_election.cc:400] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:51.070394  6217 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:13:51.005100  6123 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.074604  4363 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:51.062227  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:13:51.063912  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 118551us
I20260709 12:13:51.030282  6095 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.101917  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.096591  4358 raft_consensus.cc:2376] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4. Re-sending same reply.
I20260709 12:13:51.108594  4331 leader_election.cc:403] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:51.109046  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.117285  4364 raft_consensus.cc:2368] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
W20260709 12:13:51.120033  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 57915.8us
I20260709 12:13:51.079116  6126 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.120996  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.096550  5820 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.121966  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:50.979383  6161 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.125434  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:51.125677  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55200.4us
I20260709 12:13:51.139796  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.139928  4363 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:51.140208  4331 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:51.126399  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 95749.9us
I20260709 12:13:51.127461  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.127638  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.143149  4407 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.143502  4358 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:51.129772  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.119998  5856 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.125351  6208 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.075702  4509 rpcz_store.cc:276] 0709 12:13:49.643986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.649174 (+  5188us) service_pool.cc:224] Handling call
0709 12:13:50.995923 (+1346749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:51.108054  5907 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:51.145239  4432 raft_consensus.cc:1240] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.120323  6179 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.147064  4358 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.170351  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:51.194090  4440 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.154824  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.192118  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:51.192993  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 49910.6us
I20260709 12:13:51.195631  4407 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.171941  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.197955  4361 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:51.126077  6095 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:51.125895  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.139271  5839 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.199577  4364 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:51.156386  6215 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.154152  5907 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:51.241057  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 140083us
I20260709 12:13:51.191782  6208 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.168095  6123 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.198493  6179 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:51.144750  6246 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.192206  6174 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.169286  6027 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:51.245048  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 102918us
I20260709 12:13:51.242897  4438 raft_consensus.cc:1240] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:51.248805  4364 raft_consensus.cc:1240] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:51.246786  6195 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.250274  6271 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:51.251677  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 124289us
I20260709 12:13:51.244555  5907 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.260609  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:51.261803  4481 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.257285  4331 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:51.251540  6179 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.262997  6027 raft_consensus.cc:2764] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:13:51.263065  6217 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.256318  6246 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.269311  6246 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.256697  6174 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.271242  6268 consensus_queue.cc:1059] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:51.272091  6215 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.273656  6174 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.263417  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.275182  6215 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:51.275681  6215 raft_consensus.cc:697] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:51.276669  6215 consensus_queue.cc:237] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.277308  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:51.278213  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:51.278955  6208 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.279434  6174 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.279667  6208 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:51.279922  6174 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.280192  6208 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.280445  6174 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.280687  6208 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.281193  4514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1604) took 1625 ms. Trace:
I20260709 12:13:51.275755  6161 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:51.249991  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 52859.6us
I20260709 12:13:51.274747  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.281577  4514 rpcz_store.cc:276] 0709 12:13:49.655474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.662373 (+  6899us) service_pool.cc:224] Handling call
0709 12:13:49.662792 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.060511 (+1397719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.280903 (+220392us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400119254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:51.281132 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3160912128}
I20260709 12:13:51.287258  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.288141  4514 raft_consensus.cc:2410] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:51.283179  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:51.277845  6110 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.253340  6123 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.305401  4407 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.318831  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.322464  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:51.329746  4432 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:51.331727  4441 raft_consensus.cc:1240] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.337059  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.337874  4432 raft_consensus.cc:2393] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:51.296006  6161 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.347559  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.328111  6270 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.353029  6272 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:51.353765  6272 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.334506  6095 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.359361  4481 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.365773  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.367405  4432 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:51.367571  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.327965  6027 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:13:51.371425  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.375486  6270 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.376015  6272 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.378567  5839 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:51.380599  6179 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.358615  6161 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.358556  6217 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:51.392606  4515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57688 (request call id 156) took 1187 ms. Trace:
I20260709 12:13:51.393028  4515 rpcz_store.cc:276] 0709 12:13:50.204825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.289144 (+ 84319us) service_pool.cc:224] Handling call
0709 12:13:50.310406 (+ 21262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.311061 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.392371 (+1081310us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400118d50. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:51.392536 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48163200}
I20260709 12:13:51.399432  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.404258  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.414767  4515 raft_consensus.cc:1240] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:51.438072  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 143613us
I20260709 12:13:51.393735  6217 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:51.437974  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 132615us
I20260709 12:13:51.382774  6179 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.449232  4407 leader_election.cc:400] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
I20260709 12:13:51.389130  6174 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.364183  6277 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:13:51.423162  6187 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.454790  4407 leader_election.cc:400] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
I20260709 12:13:51.410758  5023 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:51.459007  4407 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.402423  6161 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.450731  6217 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.462428  4407 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.396545  6266 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 12:13:51.464986  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 93452.5us
I20260709 12:13:51.490000  6179 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.490918  6179 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.501665  4440 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:51.480340  6208 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.503607  6289 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.516599  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:51.507452  6283 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:13:51.506657  6277 raft_consensus.cc:2764] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:13:51.540747  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.533493  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.543138  4515 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
W20260709 12:13:51.517923  6279 log.cc:927] Time spent T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:51.506409  6284 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.533262  6192 raft_consensus.cc:3055] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.550593  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.524151  6161 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.530755  6027 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:51.544859  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 82534us
I20260709 12:13:51.547425  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.551339  4515 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:51.511849  6179 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.525367  6174 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.571307  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.573756  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.580125  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.581382  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.574195  4407 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.581589  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.585858  4358 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:51.519358  6287 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:13:51.587745  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.550935  6192 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:51.589839  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.593094  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.594558  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.594303  5907 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.595249  6179 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.595927  6179 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.595885  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.597162  4515 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:51.597378  5907 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.598284  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.548470  6289 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.599617  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.600437  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:51.601322  4514 raft_consensus.cc:2376] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2. Re-sending same reply.
I20260709 12:13:51.604374  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:51.575616  6258 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.575435  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.611044  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.612202  4358 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:51.600553  4515 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:51.617812  6277 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.577178  6027 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:51.619663  6277 consensus_queue.cc:1059] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:51.620826  6027 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.625741  6217 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.630772  6277 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.631381  6277 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.634276  6277 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.614084  6018 consensus_queue.cc:1059] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:51.640914  5903 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:51.641757  6208 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.641655  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.642639  5030 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:51.642860  6191 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.649685  6191 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.642858  6192 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.616757  6258 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.675860  6192 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.677655  6258 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.610577  5907 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.646689  6289 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.681682  6217 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.688429  6164 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.689976  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.693284  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.694371  4360 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:51.703657  6217 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.704851  6217 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.697681  6219 raft_consensus.cc:3055] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.713519  6219 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:51.714593  6219 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.715829  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.717304  4358 raft_consensus.cc:2368] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3.
I20260709 12:13:51.718909  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.722289  6208 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:51.722826  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.722867  6208 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.724071  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.725067  6208 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.725184  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.731401  6173 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:51.732275  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.733513  4361 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:51.761586  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.733989  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.762833  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.763550  4361 raft_consensus.cc:2393] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:51.752720  6217 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:51.743515  6018 raft_consensus.cc:3055] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.744815  6170 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:51.748066  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 68744.9us
I20260709 12:13:51.771862  4405 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:13:51.749058  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.751333  4359 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:51.753530  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 302163us
I20260709 12:13:51.754369  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.773648  4359 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.777652  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.781960  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.782802  4360 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:51.720078  4358 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:51.764326  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.791604  4361 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:51.792598  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.795680  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:51.803896  4407 leader_election.cc:336] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.810s (SENT)
I20260709 12:13:51.810487  5995 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:51.811161  5995 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.813777  5995 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:51.806867  4407 leader_election.cc:336] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.831s (SENT)
I20260709 12:13:51.815997  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.771191  6018 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:51.817742  6018 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.819178  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.786549  6127 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:13:51.820178  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.820876  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.821825  4437 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:51.822175  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.830660  6217 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:51.832330  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.832312  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.834107  4358 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:51.835180  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.832345  4432 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
W20260709 12:13:51.837590  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 333358us
W20260709 12:13:51.841585  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.845239  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:51.846117  4508 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 1.
I20260709 12:13:51.818905  6018 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.850625  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:51.856241  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.859102  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.859776  4360 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:51.861753  4515 raft_consensus.cc:1240] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:51.793773  6290 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.857182  4437 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:51.864158  4332 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.805593  6170 consensus_queue.cc:1059] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:13:51.831427  6217 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:51.867955  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:51.930022  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.941443  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.942313  4360 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:51.897414  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 442792us
I20260709 12:13:51.943333  4358 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:51.872948  4481 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Timed out: RequestConsensusVote RPC to 127.3.34.194:33573 timed out after 1.667s (SENT)
I20260709 12:13:51.945416  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.871371  4361 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:51.885239  4996 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:51.950680  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:13:51.946439  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 74266.5us
I20260709 12:13:51.951769  4332 leader_election.cc:400] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:51.944393  4406 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:51.949785  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.965328  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:51.971951  4361 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.928692  6151 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.856148  6164 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:51.982458  4332 leader_election.cc:400] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3.
I20260709 12:13:51.985065  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:51.986598  4358 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:51.867069  6290 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:51.991485  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 47952.9us
I20260709 12:13:51.896560  6218 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.993842  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:51.994112  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 121200us
I20260709 12:13:51.867576  6273 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:52.030691  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 145563us
I20260709 12:13:52.031572  4996 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.032780  4996 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:51.885356  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.034075  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:52.034778  6133 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.035384  6133 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:52.035441  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.035949  6133 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.036110  4441 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:52.034932  4437 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:52.029345  4438 raft_consensus.cc:2393] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:52.031699  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:52.040516  4996 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.046264  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.041409  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:52.049726  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.070080  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:51.993031  6110 raft_consensus.cc:3055] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.072521  4361 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:52.074927  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.075268  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:52.075451  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.076257  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:52.076277  4438 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:51.991163  6258 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:52.033082  6173 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:51.986941  6208 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.072142  4996 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:52.050772  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 274422us
I20260709 12:13:52.074271  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.955233  6269 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:13:52.081844  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.992923  6164 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:51.988487  6268 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:13:52.050359  6172 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.064378  6205 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.091225  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:52.045763  6161 consensus_queue.cc:1059] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:13:52.082533  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:51.993553  6290 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.081817  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:52.081928  6110 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:52.090726  6027 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.116794  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.069494  6289 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:52.098790  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.090632  6291 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.108515  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.112389  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.118086  6161 consensus_queue.cc:1243] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer 6b40d129d452470ba95c63b1eb11f804 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:13:52.072917  4506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.028s
I20260709 12:13:52.065534  6273 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.118057  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:52.177925  4361 raft_consensus.cc:2393] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
W20260709 12:13:52.116855  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.100000  6258 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:52.111709  6297 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 12:13:52.081867  6218 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:52.128407  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:52.094580  4359 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:52.097680  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:52.181691  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:52.179739  4506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.013s	sys 0.028s
I20260709 12:13:52.119220  6173 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:52.142339  6124 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:51.992647  6151 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.194054  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.191931  4439 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:52.172925  6156 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.195039  4359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1515) took 3744 ms. Trace:
I20260709 12:13:52.226559  4359 rpcz_store.cc:276] 0709 12:13:48.462489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.522793 (+ 60304us) service_pool.cc:224] Handling call
0709 12:13:48.523111 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:49.840893 (+1317782us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54001d36a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0ef1c0 00007f124e0f0231 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c
0709 12:13:51.750792 (+1909899us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54001d36a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e06b06f 00007f124e0e3f60 00007f124e0e57de 00007f124e0efb49 00007f124e0f0416 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62
0709 12:13:52.186844 (+436052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.187131 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201400960}
I20260709 12:13:52.228555  4359 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:52.229206  4359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1561) took 1249 ms. Trace:
I20260709 12:13:52.229612  4359 rpcz_store.cc:276] 0709 12:13:50.979653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.227860 (+1248207us) service_pool.cc:224] Handling call
0709 12:13:52.228178 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.228929 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.229150 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:52.142899  6289 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:52.193794  6144 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 12:13:52.196887  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 164812us
I20260709 12:13:52.139667  6027 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.236243  4359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 202) took 1239 ms. Trace:
I20260709 12:13:52.240636  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:52.237035  5025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44156 (request call id 233) took 2221 ms (client timeout 1541 ms). Trace:
I20260709 12:13:52.187194  6291 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:52.194759  6124 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.240190  4359 rpcz_store.cc:276] 0709 12:13:50.997198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.230394 (+1233196us) service_pool.cc:224] Handling call
0709 12:13:52.230713 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.230878 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.230905 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.230948 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.230980 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.236058 (+  5078us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.236186 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:52.241619  5025 rpcz_store.cc:269] 0709 12:13:50.014012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.019032 (+  5020us) service_pool.cc:224] Handling call
0709 12:13:52.235429 (+2216397us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54006441d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:52.235570 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545689472}
W20260709 12:13:52.235833  6302 log.cc:927] Time spent T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.244s	user 0.000s	sys 0.004s
I20260709 12:13:52.228574  6156 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:52.273372  4359 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:52.276618  4359 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.236093  6217 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:52.271277  6304 log.cc:927] Time spent T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:52.305370  4359 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:52.271471  6124 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.266026  6050 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.269114  6291 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.313144  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.315112  4440 raft_consensus.cc:1240] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.274665  6310 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.211822  6110 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.322652  4405 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:52.327286  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 255190us
W20260709 12:13:52.334887  6305 log.cc:927] Time spent T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:13:52.337260  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1557) took 1389 ms. Trace:
I20260709 12:13:52.337869  4361 rpcz_store.cc:276] 0709 12:13:50.947551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.180369 (+1232818us) service_pool.cc:224] Handling call
0709 12:13:52.180716 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.181061 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.181092 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.181623 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.308404 (+126781us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:52.308449 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.308518 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.337004 (+ 28486us) raft_consensus.cc:1685] finished
0709 12:13:52.337031 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.337189 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2964,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7482,"thread_start_us":117645,"threads_started":1,"wal-append.queue_time_us":146042}
I20260709 12:13:52.340554  4361 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:13:52.343181  6303 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:13:52.344974  4506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 1104) took 1052 ms. Trace:
W20260709 12:13:52.320817  6299 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:13:52.365455  6217 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.345498  4506 rpcz_store.cc:276] 0709 12:13:51.292991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.295052 (+  2061us) service_pool.cc:224] Handling call
0709 12:13:51.390360 (+ 95308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.458591 (+ 68231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.462113 (+  3522us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:51.545892 (+ 83779us) log.cc:844] Serialized 582 byte log entry
0709 12:13:52.210183 (+664291us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:52.228455 (+ 18272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.249939 (+ 21484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.344631 (+ 94692us) raft_consensus.cc:1685] finished
0709 12:13:52.344657 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.344872 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4759,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":5014,"thread_start_us":640409,"threads_started":1,"wal-append.queue_time_us":596245}
I20260709 12:13:52.370652  6217 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:52.372839  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 132288us
I20260709 12:13:52.373834  4332 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:52.377820  6272 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.378257  6272 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.378638  6272 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.379963  4332 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:52.362618  6301 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.382694  6218 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:52.317576  6050 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.387305  4509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 1103) took 1097 ms. Trace:
I20260709 12:13:52.388247  6319 consensus_queue.cc:1059] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:52.363240  6208 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.390126  6124 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.397879  6290 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.399894  6027 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:52.366017  6156 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.400645  6289 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:52.401341  6258 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.404460  4997 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.405208  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.402117  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.369076  6164 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.415506  4438 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:52.412744  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.381295  6217 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:52.418951  4510 raft_consensus.cc:3055] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:52.431548  4510 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:52.402107  6161 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:52.435663  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.398864  6018 consensus_meta.cc:287] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 12:13:52.347251  6173 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.445132  4510 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.446285  4510 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.382339  6095 consensus_queue.cc:1059] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:13:52.454099  4434 raft_consensus.cc:2410] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:13:52.438289  6307 log.cc:927] Time spent T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:13:52.434453  6161 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:52.471235  6318 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:52.471819  6095 raft_consensus.cc:3055] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:52.472627  6095 raft_consensus.cc:740] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:52.480360  6133 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.411653  6218 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.483223  6291 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.414852  6208 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.497737  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.471804  6318 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.484684  6161 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.491364  6241 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.492983  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1559) took 1544 ms. Trace:
I20260709 12:13:52.470449  6319 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.516829  6133 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.504444  5025 raft_consensus.cc:1240] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.514009  6241 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.496884  6156 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.503759  4358 rpcz_store.cc:276] 0709 12:13:50.948115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.228822 (+1280707us) service_pool.cc:224] Handling call
0709 12:13:52.267282 (+ 38460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.278634 (+ 11352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.278682 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.308608 (+ 29926us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.381630 (+ 73022us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:52.381669 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.381879 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.492721 (+110842us) raft_consensus.cc:1685] finished
0709 12:13:52.492742 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.492910 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14084,"raft.queue_time_us":40756,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":25323,"thread_start_us":70226,"threads_started":1,"wal-append.queue_time_us":114011}
I20260709 12:13:52.508149  6291 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.508749  5030 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.408360  4509 rpcz_store.cc:276] 0709 12:13:51.290070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.291689 (+  1619us) service_pool.cc:224] Handling call
0709 12:13:51.338567 (+ 46878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.392505 (+ 53938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.396412 (+  3907us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.455842 (+ 59430us) log.cc:844] Serialized 26 byte log entry
0709 12:13:51.983413 (+527571us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:51.987459 (+  4046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.009180 (+ 21721us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.387018 (+377838us) raft_consensus.cc:1685] finished
0709 12:13:52.387057 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.387234 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6834,"raft.queue_time_us":32679,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2819,"thread_start_us":483269,"threads_started":1,"wal-append.queue_time_us":530653}
W20260709 12:13:52.510093  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.530498  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.531085  4510 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.511683  6208 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:52.517951  6218 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:52.501057  4364 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:52.524029  4365 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:52.473933  6095 consensus_queue.cc:260] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.526026  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:52.527118  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.534375  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.526829  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.549759  4509 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:52.551721  6290 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:52.555759  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 151369us
I20260709 12:13:52.520221  6318 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.541675  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.560432  4510 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:52.594900  5028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 500) took 2208 ms. Trace:
I20260709 12:13:52.595468  5028 rpcz_store.cc:276] 0709 12:13:50.353528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.353860 (+   332us) service_pool.cc:224] Handling call
0709 12:13:50.354173 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.397823 (+ 43650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.397867 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:50.397930 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:50.397975 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.561522 (+2163547us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54007814d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:52.561583 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.561749 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99780480}
W20260709 12:13:52.604791  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 45795.4us
I20260709 12:13:52.610399  6124 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.615924  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.621292  6110 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.609812  4996 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:52.594316  6095 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.632745  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.603724  4506 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.626026  6151 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:52.637449  6316 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:52.631135  6213 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.639770  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.648939  4996 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:52.659811  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.660449  4512 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.661342  6213 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.668020  6213 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:52.668187  4512 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:52.683349  6050 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.701687  6169 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.706259  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.707528  4512 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
W20260709 12:13:52.707903  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.710553  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:52.712030  4508 raft_consensus.cc:1275] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:13:52.723419  4407 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.608s (SENT)
I20260709 12:13:52.720709  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.752640  4407 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.753521  5031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44156 (request call id 238) took 1162 ms. Trace:
I20260709 12:13:52.740913  4996 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:52.754470  4510 raft_consensus.cc:2393] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:52.666965  6291 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:52.755517  6124 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:52.754170  5031 rpcz_store.cc:276] 0709 12:13:51.552359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.552590 (+   231us) service_pool.cc:224] Handling call
0709 12:13:52.639527 (+1086937us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:13:52.714657 (+ 75130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9976576}
W20260709 12:13:52.664539  6205 consensus_meta.cc:287] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 12:13:52.719694  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.713754  6208 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.761377  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.760898  6169 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.792098  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.775373  6151 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.793470  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.725345  6027 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:13:52.777626  6205 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.795684  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.796384  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.797004  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.784072  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:52.798216  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.783332  6291 raft_consensus.cc:697] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:52.799319  4481 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.799785  4509 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:52.802794  4509 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.803097  4481 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.804400  5022 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:52.801348  6217 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.786499  6124 raft_consensus.cc:697] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:52.812161  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.813078  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.813277  4509 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:52.812745  6324 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:52.814766  6285 log.cc:927] Time spent T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 1.230s	user 0.002s	sys 0.002s
I20260709 12:13:52.814901  6324 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:52.815487  6324 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.815357  6124 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.816617  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.782778  6272 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.800428  6208 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.798530  6151 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.824155  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:52.818233  6328 log.cc:927] Time spent T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:13:52.818660  6217 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.840597  6291 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.848278  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.850886  4406 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.858543  4406 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:52.860077  6326 log.cc:927] Time spent T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 12:13:52.864903  6187 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.864753  4406 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:52.865510  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 62521us
I20260709 12:13:52.866357  4406 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:52.867056  6120 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.867406  6173 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:52.871476  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.873696  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.875732  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.831754  6027 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.878360  4406 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:52.877202  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:52.878464  4481 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.883597  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:52.883756  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:52.885500  4432 raft_consensus.cc:2410] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:52.886466  4406 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:52.842969  6272 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.867817  6173 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.801298  6332 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:13:52.895303  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:52.895969  4514 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:52.876505  5820 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.883842  6169 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.882367  6208 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.891696  6122 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.881992  6217 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.898620  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:52.905416  4510 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.849843  6200 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:13:52.867763  6120 consensus_queue.cc:1059] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:13:52.890837  6213 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.914731  6217 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.915614  6127 raft_consensus.cc:3055] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.919759  4510 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:52.889940  6027 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.921590  6219 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.922076  6120 raft_consensus.cc:3055] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:52.920171  6151 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:52.897986  6173 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.897809  6137 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.932812  4510 raft_consensus.cc:1240] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:52.921190  6331 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:13:52.897204  6161 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:52.931845  6127 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:52.939905  6278 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 12:13:52.933197  6217 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:52.937896  6120 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:52.995646  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 67652.3us
W20260709 12:13:53.019945  4407 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.916s (SENT)
W20260709 12:13:53.071060  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 51160.1us
W20260709 12:13:52.963506  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.093521  4407 leader_election.cc:336] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.971s (SENT)
I20260709 12:13:53.094221  4407 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
W20260709 12:13:53.101539  4481 leader_election.cc:336] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.635s (SENT)
W20260709 12:13:53.143136  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.152470  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.985628  6213 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:52.999202  6151 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:53.189679  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 96209.1us
W20260709 12:13:53.073325  6156 consensus_meta.cc:287] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.006s
W20260709 12:13:53.240255  4481 leader_election.cc:336] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.674s (SENT)
I20260709 12:13:53.240903  4481 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:53.242348  4481 leader_election.cc:336] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.678s (SENT)
I20260709 12:13:53.242884  4481 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:53.223881  6127 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.278622  6127 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:53.279148  6288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.008s	sys 0.018s
W20260709 12:13:53.279532  6288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.793s	user 0.008s	sys 0.018s
W20260709 12:13:53.281577  6338 log.cc:927] Time spent T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
I20260709 12:13:53.274302  6205 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:53.288859  6205 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.301000  6027 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:53.166919  6208 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:53.205387  6200 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:53.318728  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 76398.1us
I20260709 12:13:53.357038  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:53.316372  6207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.274s	user 0.034s	sys 0.082s
I20260709 12:13:53.333398  6027 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.276597  6336 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.336093  6272 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:53.365350  6207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.323s	user 0.035s	sys 0.082s
I20260709 12:13:53.219226  6151 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:53.388564  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 197835us
I20260709 12:13:53.364684  6137 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:53.225593  6213 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:53.393121  4407 leader_election.cc:336] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.187s (SENT)
I20260709 12:13:53.404592  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1553) took 2463 ms. Trace:
I20260709 12:13:53.405129  4363 rpcz_store.cc:276] 0709 12:13:50.944136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.195441 (+251305us) service_pool.cc:224] Handling call
0709 12:13:51.235095 (+ 39654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.300731 (+ 65636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.300774 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.301356 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:13:51.411804 (+110448us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:51.454981 (+ 43177us) log.cc:844] Serialized 14 byte log entry
0709 12:13:51.455211 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.455280 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.810100 (+1354820us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18000832c0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:53.402497 (+592397us) raft_consensus.cc:1685] finished
0709 12:13:53.404351 (+  1854us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.404520 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11179,"prepare.queue_time_us":40778,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2768,"raft.queue_time_us":18824,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":7064,"spinlock_wait_cycles":4381056,"thread_start_us":169240,"threads_started":2,"wal-append.queue_time_us":159703}
I20260709 12:13:53.396732  6137 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:53.408478  6337 log.cc:927] Time spent T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:13:53.409888  6137 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.362145  6208 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:53.407640  6324 consensus_meta.cc:287] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.005s
W20260709 12:13:53.372251  6110 consensus_meta.cc:287] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.007s
I20260709 12:13:53.336892  6120 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.427554  4438 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:53.428542  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:53.390823  6272 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.412635  6205 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.426383  6324 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.460616  6120 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.472469  4363 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:13:53.480666  5030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44156 (request call id 246) took 1384 ms. Trace:
I20260709 12:13:53.481142  5030 rpcz_store.cc:276] 0709 12:13:52.096089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.096346 (+   257us) service_pool.cc:224] Handling call
0709 12:13:52.096693 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.528504 (+431811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.480364 (+951860us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400620f54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:53.480569 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947123584}
I20260709 12:13:53.464746  6161 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.470301  6217 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:53.493485  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.497890  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1578) took 1868 ms. Trace:
I20260709 12:13:53.498431  4363 rpcz_store.cc:276] 0709 12:13:51.629211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.464986 (+1835775us) service_pool.cc:224] Handling call
0709 12:13:53.470566 (+  5580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:53.473013 (+  2447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.497843 (+ 24830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.488241  6027 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:53.502556  4508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.016s	sys 0.012s
W20260709 12:13:53.503047  4508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.017s	sys 0.012s
I20260709 12:13:53.504761  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:53.506800  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 151155us
I20260709 12:13:53.499614  6217 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.511483  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:53.513907  4432 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.511932  6208 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:53.503389  6027 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.512696  6213 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:53.516433  4481 leader_election.cc:336] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.801s (SENT)
W20260709 12:13:53.524096  4481 leader_election.cc:336] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.804s (SENT)
W20260709 12:13:53.514853  6173 consensus_meta.cc:287] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 12:13:53.524755  4481 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:53.530961  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:53.532949  4481 leader_election.cc:336] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.847s (SENT)
I20260709 12:13:53.533658  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:53.516722  6272 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.545837  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:53.551273  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.544485  6241 consensus_meta.cc:287] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 1.025s	user 0.014s	sys 0.000s
I20260709 12:13:53.553221  6241 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:53.553743  4481 leader_election.cc:336] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 1.876s (SENT)
I20260709 12:13:53.555011  6027 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.556067  6241 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.556613  4515 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:53.557475  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:53.558290  5030 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 1.
W20260709 12:13:53.563841  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.567068  4481 leader_election.cc:336] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.004s (SENT)
I20260709 12:13:53.568207  4479 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:53.518958  6217 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.531400  6173 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:53.574862  6348 log.cc:927] Time spent T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:13:53.575242  4440 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 6: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:53.575840  6324 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.544291  6208 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.579352  6208 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.580325  4406 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:53.581282  6110 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.582005  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.582180  4406 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:53.583153  6282 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:53.583257  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.583184  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:53.584164  4435 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
W20260709 12:13:53.584457  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.583827  6282 raft_consensus.cc:697] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:53.585103  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.585851  6282 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.586385  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.586966  4435 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:13:53.587394  6137 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:53.587852  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:53.587926  6137 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.583104  6208 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:53.590708  6137 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:53.584350  4507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47848 (request call id 1102) took 2295 ms (client timeout 1659 ms). Trace:
W20260709 12:13:53.578795  6219 consensus_meta.cc:287] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.000s
I20260709 12:13:53.602952  4432 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
W20260709 12:13:53.600219  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.591642  6293 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.591140  6200 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:53.540199  6354 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.594297  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:53.632591  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.633414  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:53.634344  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.614104  6169 consensus_queue.cc:1059] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:53.615170  6353 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.635747  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:53.636200  6353 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:53.636732  4437 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:53.635681  6169 raft_consensus.cc:3055] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:53.637245  6169 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:53.637672  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.638495  4437 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:53.638257  6169 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.639137  6293 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.639840  6169 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.641716  6293 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.642609  6200 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.625780  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:53.633447  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.644982  6200 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.647203  4432 raft_consensus.cc:1240] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:53.626295  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 99940.4us
I20260709 12:13:53.631392  6137 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.645984  4997 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:53.573988  4506 consensus_meta.cc:287] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.905s	user 0.005s	sys 0.009s
I20260709 12:13:53.649606  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:53.650803  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:53.663264  6354 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.659730  6095 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.617069  4507 rpcz_store.cc:269] 0709 12:13:51.288520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.292199 (+  3679us) service_pool.cc:224] Handling call
0709 12:13:53.583007 (+2290808us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5800054f98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:13:53.584258 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7094144}
I20260709 12:13:53.652269  4506 raft_consensus.cc:2468] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:53.672643  4506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57688 (request call id 175) took 1142 ms. Trace:
I20260709 12:13:53.672726  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:53.673096  4506 rpcz_store.cc:276] 0709 12:13:52.530429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.533431 (+  3002us) service_pool.cc:224] Handling call
0709 12:13:53.672572 (+1139141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.675125  6289 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:53.670128  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.663837  6293 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:13:53.677240  4512 raft_consensus.cc:1240] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.678390  4996 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:53.679244  6219 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.681085  6219 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.683646  6217 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.652282  6161 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.683965  6219 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.684618  6095 raft_consensus.cc:2804] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:53.684410  6161 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.685303  6095 raft_consensus.cc:697] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:53.664140  6137 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.686482  6095 consensus_queue.cc:237] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.636740  6353 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.713281  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:53.715736  5030 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:53.718330  4432 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:13:53.687446  6244 log.cc:927] Time spent T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 2.649s	user 0.000s	sys 0.013s
I20260709 12:13:53.666375  6118 consensus_queue.cc:1059] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:13:53.715296  6270 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.691529  6027 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.723681  4479 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:53.727833  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:53.731422  5995 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:53.731870  6161 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.732064  5995 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:53.759402  6364 log.cc:927] Time spent T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:13:53.770257  4481 leader_election.cc:336] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.147s (SENT)
I20260709 12:13:53.736961  6363 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.772954  4435 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
W20260709 12:13:53.779649  4481 leader_election.cc:336] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.227s (SENT)
I20260709 12:13:53.780342  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:53.775337  6363 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.784626  6363 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.733827  6270 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.790916  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:53.794530  6265 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.811190  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:53.811903  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 192) took 3602 ms. Trace:
I20260709 12:13:53.812749  4362 rpcz_store.cc:276] 0709 12:13:50.209758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.221132 (+ 11374us) service_pool.cc:224] Handling call
0709 12:13:50.221573 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:50.222000 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.222041 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:50.222703 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 12:13:50.559880 (+337177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:50.833138 (+273258us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.836703 (+  3565us) log.cc:844] Serialized 14 byte log entry
0709 12:13:50.836952 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.837035 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.834514 (+1997479us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b180034cc00. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:52.891226 (+ 56712us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b180034cc00. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:53.686823 (+795597us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:13:53.811663 (+124840us) raft_consensus.cc:1685] finished
0709 12:13:53.811683 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.811840 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3111,"prepare.queue_time_us":273336,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":26041,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":47922,"spinlock_wait_cycles":197442688,"thread_start_us":477443,"threads_started":2,"wal-append.queue_time_us":727767}
I20260709 12:13:53.819617  6137 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.820842  5995 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.821271  6354 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:53.812909  4508 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:53.837855  6363 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.783680  6217 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.840567  6270 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:53.841501  6280 raft_consensus.cc:3055] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:53.841259  6265 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:53.843528  4512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1617) took 1137 ms. Trace:
W20260709 12:13:53.845678  4407 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41885 timed out after 2.216s (SENT) [suppressed 50 similar messages]
I20260709 12:13:53.852882  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:53.856653  4512 rpcz_store.cc:276] 0709 12:13:52.705673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.708312 (+  2639us) service_pool.cc:224] Handling call
0709 12:13:53.676984 (+968672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.677770 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.843313 (+165543us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400059bd0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.843461 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226705280}
W20260709 12:13:53.859988  4366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1537) took 2939 ms (client timeout 1810 ms). Trace:
W20260709 12:13:53.860486  4366 rpcz_store.cc:269] 0709 12:13:50.918444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.972423 (+ 53979us) service_pool.cc:224] Handling call
0709 12:13:53.857188 (+2884765us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54003557d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.857330 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128665472}
I20260709 12:13:53.865741  6151 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.868680  6363 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:53.854893  6280 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:53.870435  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:53.870302  6280 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.871086  5030 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.871526  6280 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:53.872169  4365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1562) took 2892 ms (client timeout 1993 ms). Trace:
I20260709 12:13:53.872323  4361 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:13:53.872597  4365 rpcz_store.cc:269] 0709 12:13:50.980003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.033523 (+ 53520us) service_pool.cc:224] Handling call
0709 12:13:53.871936 (+2838413us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003566d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.872099 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3330363648}
I20260709 12:13:53.873699  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1624) took 2336 ms. Trace:
I20260709 12:13:53.874054  4361 rpcz_store.cc:276] 0709 12:13:51.536868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.341540 (+804672us) service_pool.cc:224] Handling call
0709 12:13:53.872065 (+1530525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.872700 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.873519 (+   819us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003566d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.873645 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3518956928}
I20260709 12:13:53.874418  4512 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:53.875548  4512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1643) took 1056 ms. Trace:
I20260709 12:13:53.875833  4512 rpcz_store.cc:276] 0709 12:13:52.819637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.860796 (+1041159us) service_pool.cc:224] Handling call
0709 12:13:53.861122 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.875359 (+ 14237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.875509 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.880425  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 204) took 2028 ms. Trace:
I20260709 12:13:53.880700  4365 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:13:53.880858  4361 rpcz_store.cc:276] 0709 12:13:51.853360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.879657 (+2026297us) service_pool.cc:224] Handling call
0709 12:13:53.879968 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.880127 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.880150 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.880191 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:53.880218 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.880267 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.880370 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.881486  4365 pending_rounds.cc:85] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 1
I20260709 12:13:53.882402  4365 pending_rounds.cc:107] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:13:53.882705  4365 raft_consensus.cc:2889] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:53.883364  4365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1583) took 2232 ms. Trace:
I20260709 12:13:53.883658  4365 rpcz_store.cc:276] 0709 12:13:51.650861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.873396 (+2222535us) service_pool.cc:224] Handling call
0709 12:13:53.873758 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.883136 (+  9378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.883316 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.885243  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 206) took 2029 ms. Trace:
I20260709 12:13:53.885594  4361 rpcz_store.cc:276] 0709 12:13:51.855681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.884476 (+2028795us) service_pool.cc:224] Handling call
0709 12:13:53.884769 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.884927 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.884970 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.885010 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:53.885037 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.885086 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.885194 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.887275  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 207) took 2030 ms. Trace:
I20260709 12:13:53.887625  4361 rpcz_store.cc:276] 0709 12:13:51.857057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.886491 (+2029434us) service_pool.cc:224] Handling call
0709 12:13:53.886801 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.886957 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.886981 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.887040 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:53.887067 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.887115 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.887224 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.845770  4506 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:53.891746  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 209) took 1417 ms. Trace:
I20260709 12:13:53.892731  4361 rpcz_store.cc:276] 0709 12:13:52.474770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.890846 (+1416076us) service_pool.cc:224] Handling call
0709 12:13:53.891270 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.891435 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.891464 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.891506 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:53.891536 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.891588 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.891692 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.894877  4365 raft_consensus.cc:1240] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:53.895166  4361 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:53.895787  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 210) took 1420 ms. Trace:
I20260709 12:13:53.896034  4361 rpcz_store.cc:276] 0709 12:13:52.475083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.893588 (+1418505us) service_pool.cc:224] Handling call
0709 12:13:53.893805 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.895592 (+  1787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.895749 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.897111  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 211) took 1421 ms. Trace:
I20260709 12:13:53.897372  4361 rpcz_store.cc:276] 0709 12:13:52.475420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.896593 (+1421173us) service_pool.cc:224] Handling call
0709 12:13:53.896811 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.896924 (+   113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.896938 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.896966 (+    28us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:53.896983 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.897012 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.897078 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.900696  4365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 205) took 2047 ms. Trace:
I20260709 12:13:53.901190  4365 rpcz_store.cc:276] 0709 12:13:51.855373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.884350 (+2028977us) service_pool.cc:224] Handling call
0709 12:13:53.894695 (+ 10345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.899460 (+  4765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.900623 (+  1163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:53.903221  4361 raft_consensus.cc:3055] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:53.903852  4361 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:53.898633  5027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 510) took 2145 ms (client timeout 1777 ms). Trace:
W20260709 12:13:53.915889  4364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1569) took 2617 ms (client timeout 1608 ms). Trace:
W20260709 12:13:53.916337  4364 rpcz_store.cc:269] 0709 12:13:51.298492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.367297 (+ 68805us) service_pool.cc:224] Handling call
0709 12:13:52.402747 (+1035450us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b54003cc6a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0f0e18 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6
0709 12:13:53.915706 (+1512959us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000f5854. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.915817 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386560512}
I20260709 12:13:53.923770  4407 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:53.925098  4407 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:53.929121  6169 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:53.929849  6169 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:53.909052  5027 rpcz_store.cc:269] 0709 12:13:51.750292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.753189 (+  2897us) service_pool.cc:224] Handling call
0709 12:13:53.852613 (+2099424us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:13:53.895133 (+ 42520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9131392}
I20260709 12:13:53.923076  4507 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:53.933189  6270 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:53.939539  4506 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:53.941025  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:53.941623  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44136 (request call id 468) took 2056 ms. Trace:
I20260709 12:13:53.943591  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1581) took 2313 ms. Trace:
W20260709 12:13:53.946489  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.941597  6263 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:53.942325  5022 rpcz_store.cc:276] 0709 12:13:51.884878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.885504 (+   626us) service_pool.cc:224] Handling call
0709 12:13:52.241023 (+355519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.804826 (+563803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.844202 (+1039376us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54006441d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:53.941400 (+ 97198us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54006441d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:53.941557 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067213440}
I20260709 12:13:53.909783  4361 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:53.959154  5030 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:53.962538  4366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1582) took 2332 ms. Trace:
I20260709 12:13:53.962546  4479 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:53.963248  4366 rpcz_store.cc:276] 0709 12:13:51.630377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.861461 (+2231084us) service_pool.cc:224] Handling call
0709 12:13:53.861760 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.861963 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:53.903490 (+ 41527us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.961844 (+ 58354us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.962082 (+   238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.962149 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:53.962210 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.962296 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.962448 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":791,"prepare.queue_time_us":74842,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":29,"raft.queue_time_us":882,"thread_start_us":97783,"threads_started":2}
W20260709 12:13:53.964782  4331 connection.cc:256] RPC call timeout handler was delayed by -1.3100810969999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 12:13:53.978206  4331 connection.cc:256] RPC call timeout handler was delayed by -1.2572560769999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:13:53.964444  4361 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:53.981422  4331 connection.cc:256] RPC call timeout handler was delayed by -1.1339560769999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:13:53.982214  4331 connection.cc:256] RPC call timeout handler was delayed by -1.1336810969999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 12:13:53.976257  6256 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 2.937s	user 0.008s	sys 0.006s
W20260709 12:13:53.971112  6368 log.cc:927] Time spent T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:53.988034  4508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1645) took 1157 ms. Trace:
I20260709 12:13:53.941730  4506 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:53.981245  5995 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.964001  6169 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:13:53.983072  6151 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.983553  4331 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:53.961158  6289 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:13:53.965588  6265 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:53.976948  6167 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:53.980535  6137 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:53.963086  6194 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:13:53.961380  6271 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:13:53.972294  6200 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:13:54.007218  6161 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.003556  4331 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.024089  4331 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:53.988814  4508 rpcz_store.cc:276] 0709 12:13:52.831060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.861457 (+1030397us) service_pool.cc:224] Handling call
0709 12:13:53.891914 (+ 30457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.892173 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:53.905850 (+ 13677us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.987594 (+ 81744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.987666 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:53.987721 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.987809 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.987960 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629,"prepare.queue_time_us":16632,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7727,"thread_start_us":81344,"threads_started":1}
W20260709 12:13:54.005479  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.007333  4361 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:53.964694  6123 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:54.000617  5995 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:53.998829  6270 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:53.968815  6353 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:53.986343  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.999405  6336 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.024900  6154 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.024878  4513 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47848 (request call id 1092) took 3177 ms. Trace:
I20260709 12:13:54.026467  6272 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.007424  6151 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.016776  6167 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:54.033893  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.028121  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.036600  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:54.028272  6291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.006s	sys 0.010s
W20260709 12:13:54.038399  5023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44146 (request call id 504) took 3625 ms (client timeout 3159 ms). Trace:
W20260709 12:13:54.038887  5023 rpcz_store.cc:269] 0709 12:13:50.413223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.413757 (+   534us) service_pool.cc:224] Handling call
0709 12:13:54.032955 (+3619198us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54002968d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:54.038320 (+  5365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423431040}
I20260709 12:13:54.032902  4513 rpcz_store.cc:276] 0709 12:13:50.845559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.851008 (+  5449us) service_pool.cc:224] Handling call
0709 12:13:50.851436 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.852376 (+   940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.852421 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.853088 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.912449 (+ 59361us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:50.912509 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.912590 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.975568 (+3062978us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:13:54.020820 (+ 45252us) raft_consensus.cc:1685] finished
0709 12:13:54.020841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.022420 (+  1579us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"spinlock_wait_cycles":59385216,"thread_start_us":7434,"threads_started":1,"wal-append.queue_time_us":183883}
I20260709 12:13:54.044370  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.046193  5995 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:54.046692  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.022230  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.049923  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.045744  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.051241  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.052186  4506 raft_consensus.cc:2410] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:54.058889  4509 raft_consensus.cc:2393] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 2: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:54.059916  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:54.037552  6291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.006s	sys 0.010s
I20260709 12:13:54.054401  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:54.034912  6270 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:54.055365  6336 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.056577  6161 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.037163  4508 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:13:54.052332  6353 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.053503  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:54.077005  4513 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.072395  4331 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.088024  5023 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:54.088238  6270 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.089145  6151 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.074569  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.097071  4507 raft_consensus.cc:2410] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:54.097522  4360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1558) took 3149 ms. Trace:
I20260709 12:13:54.098299  4507 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:54.112536  4434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1688) took 2078 ms (client timeout 2174 ms). Trace:
I20260709 12:13:54.098134  4360 rpcz_store.cc:276] 0709 12:13:50.947825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.185644 (+1237819us) service_pool.cc:224] Handling call
0709 12:13:52.224946 (+ 39302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:52.225432 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.225479 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:52.236439 (+ 10960us) log.cc:844] Serialized 52 byte log entry
0709 12:13:52.359301 (+122862us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:52.496866 (+137565us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.498463 (+  1597us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.096440 (+1597977us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b1800312520. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124dca3d70 00007f124dc97293 00007f124dc8ccea 00007f124dc8d23a 00007f124e0f7a2a 00007f124e1070bf 00007f124e107038
0709 12:13:54.096831 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.097008 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.097210 (+   202us) raft_consensus.cc:1685] finished
0709 12:13:54.097254 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.097445 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1556142,"prepare.queue_time_us":36146,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":92,"raft.queue_time_us":14695,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":14210,"spinlock_wait_cycles":9454336,"thread_start_us":180183,"threads_started":2,"wal-append.queue_time_us":90765}
I20260709 12:13:54.101161  6273 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.107498  6336 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.107975  6144 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.115707  6144 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.117959  4507 raft_consensus.cc:1240] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:54.108982  6167 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.108615  4514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1628) took 1385 ms. Trace:
W20260709 12:13:54.122273  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.120219  4514 rpcz_store.cc:276] 0709 12:13:52.722860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.907432 (+184572us) service_pool.cc:224] Handling call
0709 12:13:52.936260 (+ 28828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.936466 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:52.984348 (+ 47882us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.102826 (+1118478us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800187180. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d23a
0709 12:13:54.108266 (+  5440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.108319 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:54.108362 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.108432 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.108553 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48423,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":7619,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2818304,"thread_start_us":170477,"threads_started":1,"wal-append.queue_time_us":442652}
I20260709 12:13:54.124401  4514 raft_consensus.cc:1240] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:54.113046  4434 rpcz_store.cc:269] 0709 12:13:52.033798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.050476 (+ 16678us) service_pool.cc:224] Handling call
0709 12:13:54.112315 (+2061839us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400156b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:54.112468 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786758272}
W20260709 12:13:54.135573  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 63309.7us
W20260709 12:13:54.138619  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.136745  4331 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.143199  4511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1611) took 4410 ms. Trace:
I20260709 12:13:54.144464  5995 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.153276  4513 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:13:54.145615  4331 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:54.143162  6215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.791s	user 0.025s	sys 0.016s
I20260709 12:13:54.144871  6167 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.130299  5023 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:54.163866  6167 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.164475  6167 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.147214  5856 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.168066  4479 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.169032  4331 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.143764  4511 rpcz_store.cc:276] 0709 12:13:49.732856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.074578 (+341722us) service_pool.cc:224] Handling call
0709 12:13:50.101667 (+ 27089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.101922 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:50.361660 (+259738us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.911816 (+3550156us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b18002a5680. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f1251ae53c7 00007f124e0f79a7 00007f124e1070bf 00007f124e107038
0709 12:13:54.029903 (+118087us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.142820 (+112917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.142874 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:54.142918 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.143020 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.143136 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166726,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":1400,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15034,"spinlock_wait_cycles":75838336,"thread_start_us":1109100,"threads_started":4,"wal-append.queue_time_us":738755,"wal-append.run_cpu_time_us":1370,"wal-append.run_wall_time_us":1069037}
W20260709 12:13:54.161443  6215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.809s	user 0.025s	sys 0.017s
I20260709 12:13:54.172678  6363 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:54.158962  6261 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.176590  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.179754  4359 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:54.179011  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.180965  4366 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.182968  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.183429  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.183702  4366 raft_consensus.cc:2393] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.183945  4361 raft_consensus.cc:1240] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:54.184113  4359 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:54.184988  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.185204  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.185410  4361 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:13:54.185582  4359 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:54.185819  4361 pending_rounds.cc:85] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 2
I20260709 12:13:54.186125  4361 pending_rounds.cc:107] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:13:54.186386  4361 raft_consensus.cc:2889] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:54.188511  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.188647  4360 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:54.188666  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.189240  4365 raft_consensus.cc:2393] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.184490  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.190572  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.191612  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.191900  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.192231  4366 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.192715  4361 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:54.177301  6272 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:54.197189  6272 raft_consensus.cc:697] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:54.198324  6272 consensus_queue.cc:237] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.193903  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.194334  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.195003  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.203899  4361 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.204833  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.201761  4365 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:54.179557  6261 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:54.211802  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.214375  4360 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:54.190322  6363 raft_consensus.cc:697] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:54.215447  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.216785  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.217322  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.217533  4361 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:54.218564  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.218871  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.220811  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.225850  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.221362  4361 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:54.227860  4366 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:54.229063  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.228504  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.230355  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.230134  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.216075  6261 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.232662  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.233492  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.234174  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.231945  4360 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:54.234287  4361 raft_consensus.cc:2376] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3. Re-sending same reply.
I20260709 12:13:54.237882  4365 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.238615  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.239421  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.239655  4366 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:54.241245  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.240272  4359 raft_consensus.cc:2376] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5. Re-sending same reply.
I20260709 12:13:54.241689  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.243938  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.245211  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.247299  4513 raft_consensus.cc:1240] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.249722  4365 raft_consensus.cc:2393] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.251809  4361 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.252161  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.252979  4513 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:54.255187  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.255585  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.257025  4513 raft_consensus.cc:2410] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:13:54.259434  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:54.260318  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.261188  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:54.266263  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.267853  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.271911  4366 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:54.267623  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.268572  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.275657  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.276749  4360 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.277381  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.264722  5820 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:13:54.286098  6384 log.cc:927] Time spent T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:13:54.273787  6271 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:54.269604  6178 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.290277  6178 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:54.290458  4434 raft_consensus.cc:3055] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.290906  4434 raft_consensus.cc:740] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:54.273554  6137 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:13:54.281198  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.291877  4434 consensus_queue.cc:260] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.292347  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.292902  4434 raft_consensus.cc:3060] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.293679  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.294219  6144 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.294581  4360 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:54.294807  4507 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.295064  6363 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:54.295831  6343 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.770s	user 0.000s	sys 0.002s
I20260709 12:13:54.297094  4433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37854 (request call id 1182) took 1890 ms. Trace:
W20260709 12:13:54.284278  6386 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:13:54.290809  6178 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.280370  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.276588  4407 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:54.269454  6273 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.270716  6270 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.297477  4433 rpcz_store.cc:276] 0709 12:13:52.406929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.917524 (+510595us) service_pool.cc:224] Handling call
0709 12:13:52.917946 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.918353 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.918384 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.918906 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.400675 (+481769us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:53.400743 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.400855 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.295222 (+894367us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:13:54.296799 (+  1577us) raft_consensus.cc:1685] finished
0709 12:13:54.296825 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.297039 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1776,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6819,"spinlock_wait_cycles":3708672,"thread_start_us":417082,"threads_started":1,"wal-append.queue_time_us":567675}
I20260709 12:13:54.303810  4434 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:54.305140  4481 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.309353  4481 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.311802  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.286451  6167 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.298556  6215 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.270586  6151 consensus_queue.cc:1059] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:13:54.279690  6289 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.298177  6208 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:54.323246  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.314821  6144 consensus_queue.cc:1059] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:13:54.337037  6167 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.337513  4364 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:54.352536  4438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1707) took 1938 ms (client timeout 1714 ms). Trace:
I20260709 12:13:54.353583  4360 raft_consensus.cc:2393] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:54.338912  6293 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.354827  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.355109  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.356006  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:54.344421  6385 log.cc:927] Time spent T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:13:54.313123  5940 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.356655  4360 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.356894  5940 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.357278  5940 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.334580  6215 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.346434  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:54.303262  6273 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:54.313697  6161 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.334025  6289 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.337622  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.372538  6289 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.356060  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.374275  6123 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:54.374853  6123 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.377182  6123 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.374828  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.379375  4364 raft_consensus.cc:2393] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:54.343307  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.358701  4510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1631) took 1559 ms. Trace:
W20260709 12:13:54.353309  4438 rpcz_store.cc:269] 0709 12:13:52.414026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.497444 (+ 83418us) service_pool.cc:224] Handling call
0709 12:13:54.352247 (+1854803us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54002b25d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:54.352424 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136578432}
I20260709 12:13:54.359230  6215 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.313848  6291 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:13:54.390247  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.314236  6217 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.391278  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:54.314034  6175 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.392028  4514 raft_consensus.cc:2393] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:54.369717  6137 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:54.392525  6137 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.392896  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.393855  4514 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:54.395183  6137 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.379781  6123 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:54.354880  6293 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.397624  6293 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.397956  4507 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:13:54.398540  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 59969.3us
I20260709 12:13:54.399070  6268 raft_consensus.cc:3055] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.399475  6268 raft_consensus.cc:740] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:54.401081  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.388440  6122 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:54.388971  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.314913  6354 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.418082  4364 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
W20260709 12:13:54.425457  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.385703  4510 rpcz_store.cc:276] 0709 12:13:52.799259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.101904 (+302645us) service_pool.cc:224] Handling call
0709 12:13:53.227437 (+125533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.227694 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:53.355199 (+127505us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.358049 (+1002850us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18001871e0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287
0709 12:13:54.358196 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.358269 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:54.358335 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.358433 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.358611 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5461,"prepare.queue_time_us":130398,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":30059,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":3882,"spinlock_wait_cycles":3647360,"thread_start_us":175415,"threads_started":2,"wal-append.queue_time_us":157661}
W20260709 12:13:54.432816  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 52129.8us
I20260709 12:13:54.439210  6027 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:54.439114  6123 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:54.431280  6261 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.441644  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.443456  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.446012  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:54.407388  6161 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.425307  6354 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.448853  6354 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.449330  6161 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.449119  6269 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:54.400368  6268 consensus_queue.cc:260] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.458441  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:54.459201  4512 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:54.460029  4332 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.380945  6273 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.461987  5029 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.435267  4360 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:54.462636  5029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44136 (request call id 464) took 2615 ms. Trace:
I20260709 12:13:54.463012  5029 rpcz_store.cc:276] 0709 12:13:51.847046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.869801 (+ 22755us) service_pool.cc:224] Handling call
0709 12:13:54.461561 (+2591760us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:54.461766 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.462401 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.462582 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22475136}
I20260709 12:13:54.470438  4331 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.426288  6122 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.471946  6170 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:54.470683  5029 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:54.416059  6145 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.442708  6261 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.468209  6270 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.480016  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:54.486068  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 174353us
I20260709 12:13:54.498837  4510 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.500418  4481 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.496033  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.502343  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.499383  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.499939  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.504781  4432 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:54.489444  4332 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.440099  6027 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.509375  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.510506  4434 raft_consensus.cc:2410] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:54.509550  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.513739  4332 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.515255  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:54.516042  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.500564  6050 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.479199  6263 consensus_queue.cc:1059] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:13:54.502419  6167 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.527107  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.495020  6137 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:13:54.513108  6175 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.517743  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.524716  6108 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.499862  6099 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:54.536515  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.495143  6289 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.483235  6215 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.514883  6144 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.516718  6217 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:54.534950  6167 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:54.542336  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:54.547652  4510 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:54.529525  5022 raft_consensus.cc:1240] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:54.574107  4514 raft_consensus.cc:1240] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:13:54.547879  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:54.530793  6050 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.556574  6175 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:54.548521  4330 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.531948  6151 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.551569  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:54.511531  6332 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.556221  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.571952  6167 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.560959  6217 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.584044  5025 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:54.581670  4331 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.484972  6145 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.587455  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1577) took 2958 ms. Trace:
I20260709 12:13:54.593369  4332 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:54.559581  6272 consensus_queue.cc:1059] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:54.554152  6396 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:54.593703  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 45263.2us
I20260709 12:13:54.627748  4330 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:54.593369  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.630156  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.632558  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.574949  5940 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.601365  6332 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:54.602270  6027 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.635895  6027 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.636544  6027 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:54.586849  5027 raft_consensus.cc:2376] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3. Re-sending same reply.
I20260709 12:13:54.637123  5940 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.638351  4433 raft_consensus.cc:2368] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4.
I20260709 12:13:54.602391  6151 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.602895  6217 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.634781  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:54.639892  6363 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:54.640381  6363 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.640791  6363 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.603029  6192 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:54.643268  6192 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.643867  6192 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.603354  6208 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:54.590158  6050 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.626024  4358 rpcz_store.cc:276] 0709 12:13:51.628933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.542674 (+913741us) service_pool.cc:224] Handling call
0709 12:13:52.558838 (+ 16164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.562329 (+  3491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.562375 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.596764 (+ 34389us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.222175 (+1625411us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b18002d6100. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d0d1 00007f124e0a8a0f
0709 12:13:54.278907 (+ 56732us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:54.332803 (+ 53896us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.333103 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.333186 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.561502 (+228316us) raft_consensus.cc:1685] finished
0709 12:13:54.587257 (+ 25755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.587391 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268,"prepare.queue_time_us":54661,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":35589,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":2882,"spinlock_wait_cycles":17570944,"thread_start_us":55130,"threads_started":1,"wal-append.queue_time_us":1899560}
I20260709 12:13:54.600145  6178 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:54.604578  6395 log.cc:927] Time spent T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:13:54.605351  6261 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:54.613361  6394 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:54.573487  6263 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:54.659991  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.648912  6154 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:54.666854  4440 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37854 (request call id 1186) took 1819 ms. Trace:
I20260709 12:13:54.684702  4440 rpcz_store.cc:276] 0709 12:13:52.847630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.847810 (+   180us) service_pool.cc:224] Handling call
0709 12:13:54.666614 (+1818804us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400010754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:54.666784 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588587392}
I20260709 12:13:54.637221  6027 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.672209  4330 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:54.675482  6397 log.cc:927] Time spent T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:13:54.693454  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:54.645328  6208 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.692596  6239 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.651499  6151 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.709903  4358 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:54.689539  6261 raft_consensus.cc:697] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:54.699941  6208 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.697016  6154 raft_consensus.cc:697] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:54.718421  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 119558us
W20260709 12:13:54.737002  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 89688.1us
I20260709 12:13:54.738564  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.689992  6263 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.718039  6137 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:54.732028  6404 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.700142  6403 consensus_queue.cc:1059] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:13:54.760928  6400 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:13:54.777539  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.751376  6175 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:54.764377  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.763406  6289 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.764267  6143 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.785567  6215 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.798849  6178 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.811882  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:54.793358  6396 raft_consensus.cc:697] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:54.780984  6137 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.815202  4513 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.797684  6409 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.809429  6151 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.819427  6151 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.819783  6409 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.821552  6151 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.821792  6217 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.781989  6404 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.823665  6396 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.825073  6265 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.825523  6265 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:54.825966  6404 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.798118  6239 raft_consensus.cc:697] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:54.833019  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 94538.2us
I20260709 12:13:54.826385  6265 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.836066  6265 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.788345  6261 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.841044  6137 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.811630  6145 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.818547  6413 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.842751  6413 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:54.843489  6405 log.cc:927] Time spent T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:13:54.846704  6363 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.846742  6420 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:54.793869  6154 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.848099  6420 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.849303  6363 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.851730  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.816874  6289 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.847167  6409 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.853564  6289 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.857577  6289 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.858418  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:54.858012  6273 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.858868  6412 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.858394  6239 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.867625  4513 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:54.875013  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:54.823689  6399 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:13:54.878413  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44110.5us
I20260709 12:13:54.883378  6323 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:54.884052  6323 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:54.885146  6323 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.880800  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.810415  6143 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:13:54.899916  6241 raft_consensus.cc:3055] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:54.900365  6241 raft_consensus.cc:740] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:54.901232  6241 consensus_queue.cc:260] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.901499  6354 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.902598  6241 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.845826  6413 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.862349  6420 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:54.908318  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.913270  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:54.916620  6336 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.899369  6167 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.917088  6336 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:54.917539  6336 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.911422  6170 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.914615  6413 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:54.898820  6192 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.921855  6417 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:54.922829  6122 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.940805  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:54.943274  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.920822  6208 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.941363  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.954773  4432 raft_consensus.cc:1240] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.958273  4439 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:54.959689  6208 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.960343  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.960510  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:54.908041  6175 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.964262  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:54.975778  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:54.988184  5022 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:13:54.980832  6167 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.961105  5027 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:54.937727  6413 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:54.969411  6217 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:54.937577  6050 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:54.981021  6263 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:54.979270  6353 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:55.033784  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 51580.3us
I20260709 12:13:55.003240  6354 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:55.055276  4479 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:55.014568  6273 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.064586  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.082413  6143 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.082935  5027 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:55.084601  6172 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.085331  6172 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.090510  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.091430  4361 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:55.059046  6217 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.093770  6217 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.094137  6217 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.094878  6354 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:55.096052  5856 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:55.096684  5856 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.100617  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.100528  6172 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.108497  6050 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.113704  4330 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:55.104050  6413 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.118177  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.141539  4363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1579) took 3512 ms. Trace:
I20260709 12:13:55.142369  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.143468  4513 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:55.093289  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.146729  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.148226  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.119491  4512 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.134701  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.150518  4361 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:13:55.150004  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.152266  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.139253  6192 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.055424  6353 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.153556  4513 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:13:55.157358  6412 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.157876  5856 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:55.182706  6398 log.cc:927] Time spent T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.531s	user 0.004s	sys 0.000s
I20260709 12:13:55.161513  4360 raft_consensus.cc:1240] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.944166  4362 rpcz_store.cc:276] 0709 12:13:51.630064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.815055 (+2184991us) service_pool.cc:224] Handling call
0709 12:13:53.815673 (+   618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.816577 (+   904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.816632 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.817441 (+   809us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.845626 (+ 28185us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:53.942594 (+ 96968us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.943138 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.943259 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.943320 (+    61us) raft_consensus.cc:1685] finished
0709 12:13:53.943340 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.943516 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90898,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":975,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"thread_start_us":108439,"threads_started":2,"wal-append.queue_time_us":57168}
I20260709 12:13:55.152031  6143 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.188786  4362 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:13:55.168906  4515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1636) took 2363 ms. Trace:
W20260709 12:13:55.190191  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 69313.3us
I20260709 12:13:55.141966  4363 rpcz_store.cc:276] 0709 12:13:51.629483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.525564 (+1896081us) service_pool.cc:224] Handling call
0709 12:13:53.536470 (+ 10906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.536820 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.536839 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.537175 (+   336us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.630964 (+ 93789us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:53.665018 (+ 34054us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.665973 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.666060 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.936401 (+270341us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18001d1f40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:55.134451 (+1198050us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18001d1f40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:55.141316 (+  6865us) raft_consensus.cc:1685] finished
0709 12:13:55.141340 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.141477 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34022,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1512,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":7756,"spinlock_wait_cycles":14800896,"thread_start_us":50458,"threads_started":2,"wal-append.queue_time_us":96377}
I20260709 12:13:55.178014  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.179816  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:55.143196  6428 log.cc:927] Time spent T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:55.158838  6052 consensus_queue.cc:1059] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:55.195785  4358 raft_consensus.cc:1240] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.189291  4515 rpcz_store.cc:276] 0709 12:13:52.805481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.557398 (+751917us) service_pool.cc:224] Handling call
0709 12:13:53.557703 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.936133 (+378430us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:13:53.936447 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.028886 (+ 92439us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.029398 (+   512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:54.029447 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:54.029495 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.072242 (+ 42747us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b18003a3120. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:54.113432 (+ 41190us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b18003a3120. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:55.097853 (+984421us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003a3120. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:55.167670 (+ 69817us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b18003a3120. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afce2a6 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419
0709 12:13:55.168639 (+   969us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400017f54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:55.168682 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.168821 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2361,"prepare.queue_time_us":35897,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":2331,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":2648,"spinlock_wait_cycles":904556800,"thread_start_us":89494,"threads_started":1,"wal-append.queue_time_us":143735,"wal-append.run_cpu_time_us":1193,"wal-append.run_wall_time_us":1027307}
W20260709 12:13:55.184353  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.151547  6433 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:13:55.192554  5029 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.171854  6167 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.195443  4512 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.185720  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.186501  6265 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:13:55.235989  5856 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:55.245828  6425 log.cc:927] Time spent T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:55.248024  4364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1609) took 1057 ms. Trace:
W20260709 12:13:55.251758  6423 log.cc:927] Time spent T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:13:55.265316  4364 rpcz_store.cc:276] 0709 12:13:54.190172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.859584 (+669412us) service_pool.cc:224] Handling call
0709 12:13:54.859889 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.881369 (+ 21480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.881431 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.882061 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.011168 (+129107us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:55.055304 (+ 44136us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.065672 (+ 10368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.065745 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.247711 (+181966us) raft_consensus.cc:1685] finished
0709 12:13:55.247744 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.247943 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31070,"prepare.queue_time_us":44746,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1572,"raft.queue_time_us":47559,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":138332416,"thread_start_us":128604,"threads_started":1,"wal-append.queue_time_us":297304}
I20260709 12:13:55.255935  5995 consensus_queue.cc:1059] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:55.267575  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.268553  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.227141  6273 raft_consensus.cc:3055] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.268896  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:55.244725  6050 raft_consensus.cc:3055] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.236598  6396 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.274614  5029 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.270334  6421 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:55.244547  6122 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.276844  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.309811  5031 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
W20260709 12:13:55.309834  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 148029us
I20260709 12:13:55.226768  6167 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.275144  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.278491  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.270511  6435 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.315222  6435 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.312685  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.313911  6353 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:55.314615  6027 consensus_meta.cc:287] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:13:55.317623  4405 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:55.274472  6273 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:55.276186  6050 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:55.331082  6027 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.331468  6050 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.323546  4508 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:55.326923  5026 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:55.278721  6336 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:55.339893  6429 log.cc:927] Time spent T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:55.340807  6336 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:55.341583  4366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1610) took 1151 ms. Trace:
I20260709 12:13:55.341962  4366 rpcz_store.cc:276] 0709 12:13:54.190444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.904875 (+714431us) service_pool.cc:224] Handling call
0709 12:13:54.905284 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.905601 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.905629 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.906064 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.978753 (+ 72689us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:54.978812 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.978910 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.341387 (+362477us) raft_consensus.cc:1685] finished
0709 12:13:55.341407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.341527 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4235,"raft.queue_time_us":4109,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5044,"thread_start_us":72382,"threads_started":1,"wal-append.queue_time_us":289251}
I20260709 12:13:55.311134  6421 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.307781  6265 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.326913  6178 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:55.352927  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:55.346035  4406 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:55.364192  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 164099us
I20260709 12:13:55.365527  4357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1545) took 4417 ms. Trace:
I20260709 12:13:55.365362  5029 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:55.344674  6265 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.366333  4357 rpcz_store.cc:276] 0709 12:13:50.933543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.140917 (+207374us) service_pool.cc:224] Handling call
0709 12:13:53.857441 (+2716524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.857776 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.857809 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.857857 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:53.857886 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.857948 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.350638 (+1492690us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54003557d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:55.350759 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":18352,"spinlock_wait_cycles":6246674176}
I20260709 12:13:55.306856  6396 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.351739  6137 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:55.347591  5024 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:55.370633  5940 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:55.362762  4507 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:55.372665  6323 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:55.375274  6178 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:55.402866  6435 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.405285  6323 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.394654  6137 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.407732  4360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1659) took 1187 ms. Trace:
I20260709 12:13:55.331426  6273 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.416955  6336 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:55.423972  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1611) took 1233 ms. Trace:
I20260709 12:13:55.435564  4361 rpcz_store.cc:276] 0709 12:13:54.190762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.151251 (+960489us) service_pool.cc:224] Handling call
0709 12:13:55.151590 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.174425 (+ 22835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.174470 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:55.175063 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.277678 (+102615us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:55.277988 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.278298 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.278362 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.423774 (+145412us) raft_consensus.cc:1685] finished
0709 12:13:55.423792 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.423914 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51349,"prepare.queue_time_us":28727,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":29535,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6125,"spinlock_wait_cycles":5246848,"thread_start_us":102235,"threads_started":1,"wal-append.queue_time_us":195420}
I20260709 12:13:55.409793  4360 rpcz_store.cc:276] 0709 12:13:54.220248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.186453 (+966205us) service_pool.cc:224] Handling call
0709 12:13:55.186799 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.195791 (+  8992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.195830 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:55.220755 (+ 24925us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.319372 (+ 98617us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:55.364463 (+ 45091us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.364833 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.364956 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.407523 (+ 42567us) raft_consensus.cc:1685] finished
0709 12:13:55.407541 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.407673 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14785,"prepare.queue_time_us":42783,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":9179,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12398,"spinlock_wait_cycles":7340288,"thread_start_us":68107,"threads_started":1,"wal-append.queue_time_us":163606}
I20260709 12:13:55.417512  6265 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.419863  6173 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.421435  6396 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.415328  6421 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:55.431366  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.369905  6217 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.406783  6122 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.406643  5940 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:55.452978  6410 log.cc:927] Time spent T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.697s	user 0.000s	sys 0.003s
I20260709 12:13:55.461580  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.462903  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.464430  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.457377  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.466003  4510 raft_consensus.cc:1240] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:55.468319  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.469202  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.469972  4364 raft_consensus.cc:2393] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:55.470506  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.472262  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.480633  6323 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.481020  5940 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.483551  6137 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.484534  6217 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.487679  4360 raft_consensus.cc:2393] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
W20260709 12:13:55.487977  4509 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57688 (request call id 181) took 1922 ms (client timeout 1646 ms). Trace:
W20260709 12:13:55.488400  4509 rpcz_store.cc:269] 0709 12:13:53.565354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.633094 (+ 67740us) service_pool.cc:224] Handling call
0709 12:13:55.487735 (+1854641us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400119754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:55.487898 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975932160}
I20260709 12:13:55.428293  6178 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.491214  4511 raft_consensus.cc:1240] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:55.492694  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.493409  4366 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:55.495442  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:55.459245  6273 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.498260  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:55.441731  6336 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.498850  5031 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.492394  6173 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.458760  6122 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.522786  4433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37844 (request call id 1720) took 1026 ms. Trace:
I20260709 12:13:55.523435  4433 rpcz_store.cc:276] 0709 12:13:54.496072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.499029 (+  2957us) service_pool.cc:224] Handling call
0709 12:13:55.522432 (+1023403us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400156b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:55.522694 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280865024}
I20260709 12:13:55.525847  6287 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.526427  6287 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.528321  6336 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:55.528652  6287 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.514050  5024 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:55.516746  6167 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.514802  6173 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.540537  6122 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.541689  6449 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.542241  6449 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.542835  6178 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.544359  6449 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.549911  6162 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:55.550189  6173 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.557478  5030 raft_consensus.cc:1240] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:55.558285  5030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 524) took 1057 ms. Trace:
I20260709 12:13:55.558627  5030 rpcz_store.cc:276] 0709 12:13:54.500641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.500777 (+   136us) service_pool.cc:224] Handling call
0709 12:13:54.517368 (+ 16591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.557310 (+1039942us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400620aa0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0ef1c0 00007f124e0f0231 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c
0709 12:13:55.558007 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.558227 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82099584}
I20260709 12:13:55.560338  6162 consensus_queue.cc:1059] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:55.565156  6162 consensus_queue.cc:1243] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:55.572650  4260 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:55.574685  4260 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.579478  5031 raft_consensus.cc:2468] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:55.600063  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.603493  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.604336  4432 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:55.604480  6270 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:55.605021  6270 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.605626  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:55.606107  6408 log.cc:927] Time spent T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.849s	user 0.002s	sys 0.002s
I20260709 12:13:55.607242  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.603422  4434 raft_consensus.cc:1240] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.607825  4433 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.609377  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.610567  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.613579  5031 raft_consensus.cc:1240] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.614041  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.614785  5029 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 1.
I20260709 12:13:55.615250  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.615789  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.612361  4405 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:55.618386  4405 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:55.598677  6273 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.620241  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:55.621933  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.622153  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.623076  4439 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:55.623523  4508 raft_consensus.cc:2410] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:55.623243  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.626677  4510 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:55.620729  6453 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.628146  6453 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.628511  6453 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.628760  6052 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:55.629172  6052 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:55.629966  6052 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.629856  6454 consensus_queue.cc:1059] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:55.631364  6052 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:55.631417  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.631933  6454 raft_consensus.cc:3055] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.632519  6454 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:55.632759  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.634070  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.620842  6137 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:13:55.636312  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.636513  4405 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:55.637042  5030 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:55.638034  4405 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:55.619885  6173 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.620154  6270 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:55.643867  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.634977  5026 raft_consensus.cc:1240] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.647467  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.633778  6454 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.649049  5853 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.669653  5853 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.642024  6449 raft_consensus.cc:2804] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:55.671298  6449 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:55.671695  6449 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.672436  5853 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.668270  4405 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:55.668912  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.643368  6178 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.677052  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:55.679008  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.679577  4433 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:55.677883  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.680675  4434 raft_consensus.cc:2410] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:55.642091  6289 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.678717  6137 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:55.689853  4407 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:55.622323  6273 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.688470  4435 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:55.692262  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.689153  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:55.683648  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.688324  6173 consensus_queue.cc:1059] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:55.694134  4436 raft_consensus.cc:2393] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:55.644906  6156 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:13:55.695503  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.694099  4434 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:55.648272  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.678102  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.649137  6402 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.734053  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.692956  6137 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:55.738270  4508 raft_consensus.cc:2393] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:55.698335  6273 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.740840  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:55.747141  4508 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:55.696165  5853 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:13:55.736847  6454 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.692770  6289 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.741307  6137 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.742847  6173 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.771224  6416 consensus_queue.cc:765] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 5 is ahead of the local log (next sequential op: 5). Destination peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.4, Next index: 6, Last known committed idx: 5, Time since last communication: 0.217s
W20260709 12:13:55.777521  6406 log.cc:927] Time spent T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 1.015s	user 0.000s	sys 0.005s
I20260709 12:13:55.738585  6402 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.753571  6273 raft_consensus.cc:3055] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:55.738554  6156 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.787971  4508 raft_consensus.cc:2410] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:55.782356  6453 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.797984  6453 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.786790  6273 raft_consensus.cc:740] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:55.799685  6273 consensus_queue.cc:260] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.800987  6273 raft_consensus.cc:3060] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.804030  5022 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:55.804718  6289 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.806582  6156 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.808091  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.810014  5024 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:55.811332  6287 consensus_queue.cc:1059] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:55.811830  4330 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:55.812211  6287 consensus_queue.cc:1243] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:55.813354  6156 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:55.813905  6156 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.820170  4441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55510 (request call id 260) took 1415 ms. Trace:
I20260709 12:13:55.820647  4441 rpcz_store.cc:276] 0709 12:13:54.404830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.405124 (+   294us) service_pool.cc:224] Handling call
0709 12:13:54.405608 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.406049 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.406091 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.406656 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.624789 (+218133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:54.624827 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.624905 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.777234 (+1152329us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b24002a8198. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124ae869c4 00007f124ae84acb 00007f124b03fdc9 00007f124b03fa55 00007f124b03f09d 00007f124dc7110e 00007f124dc8888c 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221
0709 12:13:55.816035 (+ 38801us) raft_consensus.cc:1685] finished
0709 12:13:55.816056 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.820099 (+  4043us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1148,"raft.run_cpu_time_us":5965,"raft.run_wall_time_us":47617,"spinlock_wait_cycles":10111616,"thread_start_us":217562,"threads_started":1,"wal-append.queue_time_us":317083}
I20260709 12:13:55.813390  6287 raft_consensus.cc:3055] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.816244  6156 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.834688  6287 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:55.847404  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.856276  4439 raft_consensus.cc:1240] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.854126  6178 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:55.833240  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:55.835834  6453 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:13:55.864888  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 175099us
I20260709 12:13:55.854111  5940 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.869355  4407 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:55.862452  6287 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.873850  6287 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:55.876294  6455 log.cc:927] Time spent T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:13:55.868490  5024 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:55.869694  6453 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:55.862530  6178 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.888310  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.889086  6453 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:55.888340  6466 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.890491  6156 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.891104  6402 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.887024  6178 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.858376  6449 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.897418  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.904007  4407 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:55.909535  6449 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:55.928308  4432 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:55.935230  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:55.935912  5026 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.870815  5940 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:55.943126  4406 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:55.940006  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.947742  4511 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.946585  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.953738  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.954280  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.954865  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.954864  4512 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:55.956262  4511 raft_consensus.cc:1240] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.956387  4512 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:55.960304  5024 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:55.949316  4365 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:55.964636  4997 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:55.965353  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:55.965742  6287 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:55.961797  4405 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:55.966774  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:55.966179  6287 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.939793  6052 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:55.971666  4513 raft_consensus.cc:2393] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:55.971443  4508 raft_consensus.cc:1240] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.927376  6178 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:13:55.963541  6466 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:55.981285  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:55.987138  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:55.992573  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.004071  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.004815  4508 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:55.974975  6287 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.972338  6323 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:55.975276  6173 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.010754  4511 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:55.973697  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:55.980377  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.014743  5026 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:56.016945  4405 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:56.028700  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:56.093937  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 77080us
I20260709 12:13:56.100950  5940 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.012542  5806 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:13:56.016664  6261 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.017095  6453 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:56.106956  6137 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.113611  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:56.107633  6156 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.093597  6173 raft_consensus.cc:697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.116752  6173 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.121623  4479 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:56.140960  4441 raft_consensus.cc:2368] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4.
I20260709 12:13:56.141873  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:56.140215  4511 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:56.143827  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.143996  5026 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:56.144444  5030 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:56.144834  4997 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.145769  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:56.146311  5030 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.146447  4406 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:56.145294  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 157014us
I20260709 12:13:56.112443  6137 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.109252  6467 raft_consensus.cc:2804] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.157446  4406 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:56.159024  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.160459  4407 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.014662  6323 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.209708  6323 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.168562  4407 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.138911  6407 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:56.108842  6261 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.142467  6270 raft_consensus.cc:2804] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.156080  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.166553  4513 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:56.177536  6404 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:56.180745  5027 raft_consensus.cc:1240] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:56.223083  6467 raft_consensus.cc:697] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.182389  5025 raft_consensus.cc:1240] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:56.183743  6268 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.224239  6467 consensus_queue.cc:237] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.159350  5940 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.227233  6261 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.194621  6162 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:56.203473  4514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1655) took 1821 ms. Trace:
I20260709 12:13:56.212423  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.148707  6424 consensus_queue.cc:1059] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:13:56.228682  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 60262.3us
I20260709 12:13:56.230718  4514 rpcz_store.cc:276] 0709 12:13:54.382453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.394465 (+ 12012us) service_pool.cc:224] Handling call
0709 12:13:54.394849 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.574667 (+179818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.203123 (+1628456us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001856d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:13:56.203394 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411454336}
I20260709 12:13:56.224236  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44146 (request call id 530) took 1258 ms. Trace:
I20260709 12:13:56.234666  4407 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.234881  5025 rpcz_store.cc:276] 0709 12:13:54.965931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.966105 (+   174us) service_pool.cc:224] Handling call
0709 12:13:56.181902 (+1215797us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b5800080a98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:13:56.182150 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.223977 (+ 41827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.224156 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22465408}
I20260709 12:13:56.221417  6407 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.237165  4997 leader_election.cc:400] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4.
I20260709 12:13:56.237483  4997 leader_election.cc:403] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:56.238790  6296 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.240041  6431 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4.
I20260709 12:13:56.221275  6122 consensus_queue.cc:1059] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:13:56.232484  6404 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:56.246176  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 272208us
I20260709 12:13:56.148968  6161 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:13:56.219218  6289 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.221468  6137 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.227996  6449 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:56.265560  4513 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:56.219754  6322 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:13:56.250517  6414 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.238878  6407 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.263856  6137 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.238866  6162 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.282163  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.289345  4509 raft_consensus.cc:2393] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:56.275385  5030 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:56.285211  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.268970  6472 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.272883  6419 raft_consensus.cc:3055] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:56.303263  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.307544  4513 raft_consensus.cc:2393] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:56.288570  6137 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.267074  6289 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.289348  6466 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.294004  6294 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.282150  6414 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:56.328788  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 164927us
I20260709 12:13:56.302552  6419 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:56.302738  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:56.323316  4507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47840 (request call id 1665) took 1206 ms. Trace:
I20260709 12:13:56.359506  6162 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:56.357174  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 203866us
I20260709 12:13:56.353489  6404 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.336825  6287 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.375262  5024 raft_consensus.cc:2368] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4.
I20260709 12:13:56.362737  6270 raft_consensus.cc:697] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
W20260709 12:13:56.379328  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 144790us
I20260709 12:13:56.374722  6178 consensus_queue.cc:1243] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:56.343178  4507 rpcz_store.cc:276] 0709 12:13:55.117359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.142573 (+ 25214us) service_pool.cc:224] Handling call
0709 12:13:56.323070 (+1180497us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000591d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:13:56.323230 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265438592}
W20260709 12:13:56.390545  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 222696us
I20260709 12:13:56.393637  4407 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.400808  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.407689  4407 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:56.398317  5022 raft_consensus.cc:2368] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:13:56.410597  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:13:56.413805  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.413476  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:56.382612  6419 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.403470  6052 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.423890  6414 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:56.424592  6414 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:56.425033  6414 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:56.425851  6414 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.410050  6473 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.428629  6463 raft_consensus.cc:3055] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.429078  6463 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.417764  6332 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.431368  6332 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.431766  6332 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:56.433079  6454 consensus_meta.cc:287] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:13:56.435679  6419 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.395429  6465 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:13:56.446240  6484 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.448662  6289 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:56.452450  6481 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.455420  6481 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.458142  6481 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.458493  6402 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.455435  6484 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.459278  6402 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.460813  6265 raft_consensus.cc:3055] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.461215  6265 raft_consensus.cc:740] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.461288  6484 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.462013  6265 consensus_queue.cc:260] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.463871  6332 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.466395  6332 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.467615  6137 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:56.507128  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 139905us
I20260709 12:13:56.510229  4432 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
W20260709 12:13:56.513453  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.516395  4359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 1613) took 2203 ms. Trace:
W20260709 12:13:56.517890  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 108106us
W20260709 12:13:56.520939  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 107358us
W20260709 12:13:56.521209  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 113472us
I20260709 12:13:56.529500  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.517045  4359 rpcz_store.cc:276] 0709 12:13:54.313813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.188349 (+874536us) service_pool.cc:224] Handling call
0709 12:13:55.188948 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.189368 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.189433 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.199315 (+1009882us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b4c0010cf40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124c3b9a20 00007f124c3caa29 00007f124c390644 00007f124c3b7f2d 00007f124c3b7b93 00007f124e0e818b 00007f124e0e8cb5 00007f124e0ea004 00007f124e0e9729 00007f124e0eed96 00007f124e0e3adb
0709 12:13:56.200122 (+   807us) log.cc:844] Serialized 556 byte log entry
0709 12:13:56.382550 (+182428us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:56.382603 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.382702 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.515318 (+132616us) raft_consensus.cc:1685] finished
0709 12:13:56.515373 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.516099 (+   726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108253440,"thread_start_us":182089,"threads_started":1,"wal-append.queue_time_us":218649}
I20260709 12:13:56.536985  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.458799  6050 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.539637  6173 consensus_queue.cc:1059] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:56.541834  6173 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.542629  6173 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.548511  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:56.551221  6332 consensus_queue.cc:1059] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:56.547080  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.541743  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.547788  4514 raft_consensus.cc:1275] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.551458  6265 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.544426  6484 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.545940  6178 raft_consensus.cc:3055] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.567214  4507 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:56.446792  6270 consensus_queue.cc:237] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.553961  5026 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:56.570907  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.573587  6137 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.587275  6484 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.580941  6178 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.588976  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:56.592024  4441 raft_consensus.cc:1240] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:56.604728  6052 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.607147  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.609447  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.611868  6178 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:56.593433  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 70747.1us
I20260709 12:13:56.565374  6173 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.621939  6270 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.626389  4509 raft_consensus.cc:1240] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:56.637429  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.641052  6332 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:56.644299  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:56.645291  4511 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.648255  6099 raft_consensus.cc:3055] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.648415  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53846 (request call id 218) took 2020 ms. Trace:
I20260709 12:13:56.648909  6099 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:56.653564  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 315099us
I20260709 12:13:56.654402  6416 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:56.659878  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:56.660521  4361 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:56.660794  4366 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.662288  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:56.663232  4365 raft_consensus.cc:3060] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.667245  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:56.667426  6424 consensus_queue.cc:1059] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:56.668154  4359 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.668232  6122 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.668778  6122 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.669167  6122 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.671710  6465 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.671597  6162 consensus_queue.cc:1059] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:56.672843  6465 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.673681  6162 raft_consensus.cc:3055] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:56.667721  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 79006.2us
I20260709 12:13:56.674284  6162 raft_consensus.cc:740] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:56.679917  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 53287.4us
I20260709 12:13:56.681185  6162 consensus_queue.cc:260] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.683892  4997 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:56.664614  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.684244  6463 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.685148  6424 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.685654  6424 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.686142  6424 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.686658  6099 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.650000  4362 rpcz_store.cc:276] 0709 12:13:54.627959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.190328 (+562369us) service_pool.cc:224] Handling call
0709 12:13:55.190596 (+   268us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:55.221525 (+ 30929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.221570 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:55.222305 (+   735us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.352358 (+130053us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:55.380978 (+ 28620us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.208614 (+827636us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b1800320e60. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:13:56.254258 (+ 45644us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800320e60. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124b002a40 00007f124affd4e4 00007f124affd455 00007f1251ae53c7 00007f124e0f79a7 00007f124e1070bf 00007f124e107038
0709 12:13:56.262144 (+  7886us) log.cc:844] Serialized 14 byte log entry
0709 12:13:56.647118 (+384974us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b1800320e60. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124b002a40 00007f124affd4e4 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287 00007f124e108208
0709 12:13:56.647741 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.647899 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.647987 (+    88us) raft_consensus.cc:1685] finished
0709 12:13:56.647999 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.648221 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":917239,"prepare.queue_time_us":907968,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":2324,"raft.queue_time_us":427011,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":2625,"spinlock_wait_cycles":58978688,"thread_start_us":87289,"threads_started":1,"wal-append.queue_time_us":173906}
W20260709 12:13:56.687359  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 50304.4us
I20260709 12:13:56.688485  6465 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.688555  6099 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.694128  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:56.690093  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:56.690418  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:56.693039  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:56.697367  4332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.698268  5030 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:56.699061  6402 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.648926  6484 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.701068  6289 raft_consensus.cc:3055] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.704629  4511 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
W20260709 12:13:56.684458  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.708184  4260 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:56.709273  6287 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.577512  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.710261  4260 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:56.717593  5940 consensus_queue.cc:1059] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:56.718909  4360 raft_consensus.cc:2393] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:56.711367  6289 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:56.720243  5940 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:56.721617  6289 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.723429  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.726274  5030 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:56.682972  6162 raft_consensus.cc:3060] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.730145  6453 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:56.735385  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.737165  5995 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:56.740859  4406 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.704288  6270 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.744908  6480 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.746831  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.747426  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.749152  4506 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:56.749771  4263 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 143) took 10170 ms. Trace:
I20260709 12:13:56.752460  6424 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.755123  4359 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:56.755910  4364 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:56.756471  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:56.757138  4432 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.758103  6289 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.773300  6178 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.777706  5995 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:56.778576  5995 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.781309  5995 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.781917  5995 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.783361  6419 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:56.784423  6419 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.787370  6268 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.788271  6268 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.791519  6161 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.792456  6161 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.758246  6270 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.760171  4365 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:56.722638  5940 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.763252  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:56.763796  6424 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.686756  6463 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.798492  5940 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.806903  4330 leader_election.cc:400] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4.
I20260709 12:13:56.807405  4330 leader_election.cc:403] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:13:56.808033  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 95726.5us
I20260709 12:13:56.808684  5940 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.810380  5940 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.796909  4406 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:56.800676  6268 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.815282  6270 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.815891  6122 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.816293  6270 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.817848  6122 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.767808  4432 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:13:56.819180  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:56.820859  4997 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:56.821789  6424 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:56.822253  6270 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:56.822402  6424 raft_consensus.cc:697] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:56.810643  6323 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.782464  5995 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.750159  4263 rpcz_store.cc:276] 0709 12:13:46.579667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.583631 (+  3964us) service_pool.cc:224] Handling call
0709 12:13:56.749536 (+10165905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:47.986891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:48.135582 (+148691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:48.135635 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:13:48.135660 (+    25us) tablet.cc:662] Decoding operations
0709 12:13:48.136711 (+  1051us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:48.136833 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:48.136867 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:13:48.137744 (+   877us) tablet.cc:701] Row locks acquired
0709 12:13:48.137806 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:13:48.137977 (+   171us) write_op.cc:270] Start()
0709 12:13:48.138158 (+   181us) write_op.cc:276] Timestamp: P: 1783599228137911 usec, L: 0
0709 12:13:48.138182 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:48.167933 (+ 29751us) log.cc:844] Serialized 3318 byte log entry
0709 12:13:48.498591 (+330658us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:13:48.897071 (+398480us) op_driver.cc:464] REPLICATION: finished
0709 12:13:49.379676 (+482605us) write_op.cc:301] APPLY: starting
0709 12:13:49.390093 (+ 10417us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:49.437505 (+ 47412us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:49.437533 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:49.600082 (+162549us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:49.600368 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:13:49.600418 (+    50us) write_op.cc:312] APPLY: finished
0709 12:13:49.600689 (+   271us) log.cc:844] Serialized 65 byte log entry
0709 12:13:49.600870 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:49.600982 (+   112us) write_op.cc:454] Released schema lock
0709 12:13:49.601029 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:49.601406 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:49.601432 (+    26us) write_op.cc:454] Released schema lock
0709 12:13:50.978969 (+1377537us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b2000168af8. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124dc9bb91 00007f124dcbda19 00007f124dc888c3 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169 00007f124dc91131 00007f124dc9042d 0000000000388634
Metrics: {"mutex_wait_us":239622,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":423380,"apply.run_cpu_time_us":5703,"apply.run_wall_time_us":275979,"num_ops":8,"prepare.queue_time_us":222922,"prepare.run_cpu_time_us":20317,"prepare.run_wall_time_us":302720,"raft.queue_time_us":248237,"raft.run_cpu_time_us":27698,"raft.run_wall_time_us":402868,"replication_time_us":692783,"spinlock_wait_cycles":20054656,"thread_start_us":472404,"threads_started":4,"wal-append.queue_time_us":106026,"wal-append.run_cpu_time_us":35732,"wal-append.run_wall_time_us":3797429}]]}
I20260709 12:13:56.836576  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:56.840778  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.843288  4361 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:56.844699  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.850960  5022 raft_consensus.cc:1240] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:56.852036  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:56.853065  6419 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:56.855911  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.857630  6161 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:56.858386  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 115480us
I20260709 12:13:56.864289  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:56.864821  6424 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.865996  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:56.894102  4358 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:56.870359  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:56.886860  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 47833.4us
I20260709 12:13:56.888875  4366 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:56.895320  4364 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:56.908485  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.908540  6332 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.909852  4511 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:56.910051  6332 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.910493  6332 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.910786  6167 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:56.910341  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.897755  6265 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:56.926784  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.928150  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.929220  5995 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:56.929502  4363 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:13:56.931170  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 75394.8us
I20260709 12:13:56.932888  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:56.920620  6265 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.935835  6265 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.943209  6161 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:56.943295  6122 consensus_queue.cc:1059] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:56.943930  4330 leader_election.cc:400] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:13:56.944344  4330 leader_election.cc:403] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:56.944139  6161 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:56.945072  6122 raft_consensus.cc:3055] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:56.945605  6122 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:56.945977  4330 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:56.947503  6407 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:56.947057  6122 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:56.960659  6419 raft_consensus.cc:3060] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.963420  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:56.963728  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:56.964303  4507 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.964485  4512 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:56.979732  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:56.982383  4510 raft_consensus.cc:2393] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:56.967607  6268 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:56.968704  6289 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:13:56.991019  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.994307  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 61536us
I20260709 12:13:56.948342  6407 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.007135  6289 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.010552  4432 raft_consensus.cc:1240] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.015987  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:56.993445  6270 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.020706  4331 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.024315  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:57.026515  4511 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:57.028393  5023 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:57.028550  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:57.034294  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 117505us
I20260709 12:13:56.997813  6268 consensus_queue.cc:1059] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:57.019295  6122 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.036580  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:57.046681  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.050194  6407 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.051505  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:57.044039  6173 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.057482  6173 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.064160  6465 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.069053  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.069276  6465 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.065470  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.071045  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.073608  6465 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.076033  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.065939  6268 raft_consensus.cc:3055] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.079244  6268 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:57.080525  6268 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.082381  6268 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.066407  5995 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.083281  5995 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.083706  5995 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.066694  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.090762  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.067886  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.092829  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.094704  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.067993  4481 leader_election.cc:400] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4.
I20260709 12:13:57.091176  6463 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.095582  4481 leader_election.cc:403] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.042713  6323 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4.
I20260709 12:13:57.095955  6463 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.099181  6463 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.100736  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.101773  4435 raft_consensus.cc:2410] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:57.103384  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.103585  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.104202  4363 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:57.107117  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.107792  4440 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:57.113745  6265 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:57.114467  6500 log.cc:927] Time spent T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
W20260709 12:13:57.116896  6503 log.cc:927] Time spent T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:13:57.127286  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.128047  4438 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.132059  4437 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:57.136637  4507 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:57.136845  6407 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.137347  6407 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.139714  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.140786  4435 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:57.141567  6289 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.141777  4508 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
W20260709 12:13:57.145054  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 99702.9us
I20260709 12:13:57.149389  4331 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.154748  4432 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:57.155685  6162 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.157416  4438 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:57.164291  4436 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:57.171934  4434 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
W20260709 12:13:57.173100  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.163147  6419 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:13:57.187088  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.188308  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.188350  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.189751  4436 raft_consensus.cc:2410] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:57.170148  6162 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.192533  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.193058  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:57.196381  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.200668  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.203016  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.200577  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.206977  6317 consensus_queue.cc:1059] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:57.208455  6287 raft_consensus.cc:3055] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:57.208873  6287 raft_consensus.cc:740] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:57.209903  6287 consensus_queue.cc:260] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.207381  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.211202  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.212021  4364 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:13:57.212754  4359 raft_consensus.cc:1240] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:57.211310  6287 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.215233  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.199414  6162 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.219961  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.222270  4365 raft_consensus.cc:2468] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:13:57.238377  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:57.259027  4357 raft_consensus.cc:2468] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:13:57.252218  4432 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:57.252712  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.259101  5025 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:57.257740  4440 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:13:57.249213  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.251156  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.270179  4439 raft_consensus.cc:2393] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:57.261847  4441 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:57.262809  4433 raft_consensus.cc:2468] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:57.264671  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:57.264706  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 58871us
I20260709 12:13:57.274737  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.245645  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:57.281306  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.281548  4438 raft_consensus.cc:1240] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.282425  4432 raft_consensus.cc:2393] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:57.238296  6161 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.203925  5940 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.241751  6265 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.289013  4330 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:57.290922  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.292481  4439 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:57.296766  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.299511  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.237238  5995 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.287441  5022 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.312820  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:57.316915  4439 raft_consensus.cc:2410] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:57.319571  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.323308  4366 raft_consensus.cc:2393] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:57.321291  4436 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:13:57.342128  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.311774  6402 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:57.353719  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.302309  5940 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.364022  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.368677  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.369596  4433 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:13:57.365331  6490 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:13:57.372012  6436 consensus_queue.cc:1048] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:13:57.372686  5995 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.371208  6414 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4.
I20260709 12:13:57.373595  6434 consensus_queue.cc:1059] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:13:57.366935  4432 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:57.386402  4360 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:57.298906  6332 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.356642  6402 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:57.390005  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.390700  4996 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.391731  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.397492  4439 raft_consensus.cc:2393] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:57.404124  4509 raft_consensus.cc:1240] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:13:57.404958  4440 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:13:57.405385  4440 pending_rounds.cc:85] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Aborting all ops after (but not including) 1
I20260709 12:13:57.404161  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:57.409977  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:13:57.407783  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 121095us
I20260709 12:13:57.405639  4440 pending_rounds.cc:107] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:57.412725  4440 raft_consensus.cc:2889] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.412748  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.411351  6289 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.399160  6402 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.414594  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.416265  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.416823  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.418606  4433 raft_consensus.cc:2410] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:57.418502  4432 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:13:57.420274  4438 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:57.408680  6436 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.426164  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.428154  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.430743  4436 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
W20260709 12:13:57.437443  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 191143us
I20260709 12:13:57.438922  4358 raft_consensus.cc:1240] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:57.443341  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.452648  4331 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.457471  4481 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.458211  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.459178  4440 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:57.457679  6050 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.462378  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.464309  4361 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.468729  4432 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:13:57.469259  4432 pending_rounds.cc:85] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Aborting all ops after (but not including) 2
I20260709 12:13:57.469554  4432 pending_rounds.cc:107] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:13:57.469834  4432 raft_consensus.cc:2889] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.475554  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.480057  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.483796  4364 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:57.489120  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:57.489363  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.490798  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:57.444887  6436 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:13:57.495529  4435 raft_consensus.cc:2368] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5.
I20260709 12:13:57.472354  6289 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:57.500875  4514 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.486606  6270 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.503978  4358 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.505635  4364 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:57.509769  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.495795  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:13:57.516279  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 379847us
W20260709 12:13:57.516547  6507 log.cc:927] Time spent T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:13:57.524104  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.528254  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.529448  4357 raft_consensus.cc:2393] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 7: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:57.529561  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:57.532871  6167 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:57.511211  6162 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.532912  4481 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.495188  6484 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:13:57.538718  4362 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:13:57.510874  5940 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.527876  4507 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.528987  6050 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:57.525801  6270 raft_consensus.cc:697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:57.523240  6323 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:13:57.560236  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53211.6us
I20260709 12:13:57.566084  6270 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.567305  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.568357  4515 raft_consensus.cc:2410] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:57.569376  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:57.569917  4515 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.571313  6323 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.572476  4507 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:57.573760  6323 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:13:57.574795  6508 log.cc:927] Time spent T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:57.563601  6332 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.582412  4365 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:57.584419  6424 raft_consensus.cc:3055] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.584883  6424 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:57.585963  6424 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.587787  5022 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
W20260709 12:13:57.591346  6268 consensus_meta.cc:287] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.004s
I20260709 12:13:57.597297  6167 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.598332  4363 raft_consensus.cc:1240] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.599880  6167 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.600136  4357 raft_consensus.cc:1275] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:57.600772  6162 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.605165  4359 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:57.606087  4361 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:57.607496  6402 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.609035  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:57.609314  6407 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:57.609735  6402 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.542303  6289 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.613582  6289 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:57.616263  4405 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.620693  6050 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.624646  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.625939  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:57.625936  4513 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:57.630077  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.633515  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.634440  4513 raft_consensus.cc:2393] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:57.635324  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.636480  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.636765  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:57.637462  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:57.638229  6414 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.638685  6414 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.639103  6414 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.643808  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 125167us
I20260709 12:13:57.644714  4332 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.647356  4406 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.648125  6265 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.648463  6265 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.648772  6265 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:57.649436  6506 log.cc:927] Time spent T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:13:57.652249  6167 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.653533  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.654521  6289 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.654610  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:57.659624  4331 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.660414  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:57.660987  4994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.656747  6289 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:57.662549  6407 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:57.662824  6289 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.610033  6490 raft_consensus.cc:2804] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.663414  6407 raft_consensus.cc:697] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:57.664119  6490 raft_consensus.cc:697] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:57.664860  6407 consensus_queue.cc:237] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.665182  6490 consensus_queue.cc:237] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.655546  6050 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.675904  4331 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:57.675684  4358 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:57.675251  6162 consensus_queue.cc:1059] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:13:57.681108  5940 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.681571  6268 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.682019  6268 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:57.682416  6268 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.679777  4331 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.687677  4406 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:13:57.692389  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.694757  4514 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:57.692162  4364 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
W20260709 12:13:57.708599  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 71204.4us
W20260709 12:13:57.710835  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 217656us
I20260709 12:13:57.701928  6323 raft_consensus.cc:3055] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.701412  6332 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.715407  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:57.707345  6162 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.707873  6178 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:13:57.726092  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 223599us
I20260709 12:13:57.719403  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.694279  5940 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:57.714586  6424 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.727998  4407 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.738915  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:57.721128  6323 raft_consensus.cc:740] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:57.758703  4407 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:13:57.748730  5022 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:57.769006  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.744755  6463 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:57.768155  6270 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.765410  6521 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:13:57.775635  6484 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:57.774153  6463 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:13:57.786703  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 79626.1us
W20260709 12:13:57.797832  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 59835.5us
I20260709 12:13:57.777948  6178 raft_consensus.cc:697] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:57.779491  6122 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.799278  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.783975  6521 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.808198  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 61790.8us
I20260709 12:13:57.801738  4996 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:57.785260  6484 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.799686  6463 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.806823  6465 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:57.809845  6521 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:57.838356  6287 raft_consensus.cc:2804] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:57.839160  6287 raft_consensus.cc:697] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:57.840261  6287 consensus_queue.cc:237] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:57.818011  6517 log.cc:927] Time spent T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:13:57.844432  6465 raft_consensus.cc:697] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:57.845656  6465 consensus_queue.cc:237] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.806041  6332 consensus_queue.cc:1059] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:57.847972  6270 raft_consensus.cc:3055] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:57.848088  5030 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:57.848453  6270 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:57.849464  6270 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.820505  6050 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:57.819811  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:57.853634  4332 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.854557  6407 raft_consensus.cc:2749] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.855321  6407 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:57.825230  6516 log.cc:927] Time spent T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:13:57.825591  6178 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.802491  6122 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:57.860630  6122 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.861267  6484 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.823343  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:57.869717  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 60799us
I20260709 12:13:57.813432  6323 consensus_queue.cc:260] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.822836  4515 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:13:57.870931  4407 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:57.875948  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 63890.5us
W20260709 12:13:57.897928  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.905272  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:13:57.914225  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 60723us
W20260709 12:13:57.919221  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 145459us
I20260709 12:13:57.899999  6137 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.925450  4511 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.927961  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:57.929575  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:13:57.930263  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.931730  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.935163  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.944083  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 44518.2us
I20260709 12:13:57.943979  4359 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:13:57.950779  6268 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.951757  6270 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.955593  5027 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:13:57.903581  6490 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:13:57.958197  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:57.919574  6323 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.960192  4330 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:57.962922  4365 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:57.965238  4481 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:57.972034  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:57.978819  6521 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:57.980904  6167 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:57.981714  6167 raft_consensus.cc:697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:57.981009  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.982702  6167 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:57.981099  6521 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:57.962581  6268 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:57.995393  6534 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.997319  4407 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:57.973603  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:57.999208  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.000619  4511 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:58.001372  4331 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.005838  6404 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.012877  6463 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.015681  6122 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.017197  4432 raft_consensus.cc:1240] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:58.018435  6122 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.020586  4332 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.023335  6178 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.024194  6265 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.026628  6265 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.026472  6520 consensus_queue.cc:1059] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:58.022501  4332 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.066398  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:13:58.069067  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 46701.5us
I20260709 12:13:57.973778  6414 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.029423  6402 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:58.088158  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 185959us
I20260709 12:13:58.060559  6137 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:58.070096  6404 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.098598  4513 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:13:58.094060  4332 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:58.098923  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 137333us
I20260709 12:13:58.084679  6265 consensus_queue.cc:1048] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:13:58.183938  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 89956.5us
W20260709 12:13:58.203455  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 109136us
I20260709 12:13:58.204409  4407 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.206256  4407 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.214416  4332 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.172488  6404 raft_consensus.cc:697] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:13:58.192802  6532 log.cc:927] Time spent T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:13:58.185395  6534 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.188500  6463 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.193845  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:58.177529  6167 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.211854  5940 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.203100  6537 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:13:58.226366  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.252477  4433 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.227626  6414 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.220585  6407 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.229110  4437 raft_consensus.cc:1275] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:13:58.260476  4437 pending_rounds.cc:85] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Aborting all ops after (but not including) 4
I20260709 12:13:58.260744  4437 pending_rounds.cc:107] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:13:58.260968  4437 raft_consensus.cc:2889] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:58.229413  5865 raft_consensus.cc:3055] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:58.226745  6528 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:58.229828  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.220212  6465 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.255064  4358 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:13:58.274434  6528 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:58.275571  6528 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.222973  6534 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.280833  6534 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.218859  4481 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:58.281924  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 68263.4us
I20260709 12:13:58.283032  6414 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.283464  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:13:58.266206  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 60160.5us
I20260709 12:13:58.271215  6465 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.286499  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.286796  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.287415  4366 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:58.268839  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 58410.6us
I20260709 12:13:58.186873  6484 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.252864  5940 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.261857  4506 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.290030  4360 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.265691  5865 raft_consensus.cc:740] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:13:58.296111  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 69331.5us
I20260709 12:13:58.296319  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.301679  4433 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:58.303812  4366 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:58.306455  4332 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.308223  6289 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.291702  4364 raft_consensus.cc:2955] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:58.308154  6402 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:58.310920  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.313153  4358 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:13:58.314399  6544 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.328293  6484 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.328464  6544 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.297149  6490 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.336033  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.338626  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:58.305936  5940 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.340991  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.354744  4407 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.327483  6407 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.363349  6529 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.365085  6544 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.378388  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.364446  6332 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.358356  6484 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.357247  6122 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.385725  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45316 (request call id 232) took 9838 ms. Trace:
I20260709 12:13:58.336807  6526 consensus_queue.cc:1059] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:13:58.327607  6289 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.339636  6414 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:13:58.386957  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.370296  6050 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:13:58.395967  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.398449  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 62025.5us
I20260709 12:13:58.388222  4260 rpcz_store.cc:276] 0709 12:13:48.540814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.541147 (+   333us) service_pool.cc:224] Handling call
0709 12:13:58.379407 (+9838260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:57.115343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:57.116185 (+   842us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:57.116255 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:13:57.116278 (+    23us) tablet.cc:662] Decoding operations
0709 12:13:57.117076 (+   798us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:57.117179 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:57.117213 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:57.117867 (+   654us) tablet.cc:701] Row locks acquired
0709 12:13:57.117929 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:13:57.118511 (+   582us) write_op.cc:270] Start()
0709 12:13:57.118683 (+   172us) write_op.cc:276] Timestamp: P: 1783599237118431 usec, L: 0
0709 12:13:57.118721 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:13:57.155320 (+ 36599us) log.cc:844] Serialized 1694 byte log entry
0709 12:13:57.822218 (+666898us) op_driver.cc:464] REPLICATION: finished
0709 12:13:57.957341 (+135123us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5400399c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ea32a 00007f124e06ff14 00007f124e06fec3 00007f124e06fe38 00007f124e06fdf3 00007f124e06f0dc 00007f124e098e16 00007f124e080cbb 00007f124e06b39d 00007f124e06ed75
0709 12:13:57.975489 (+ 18148us) write_op.cc:301] APPLY: starting
0709 12:13:57.983099 (+  7610us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:57.983291 (+   192us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:57.983331 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:57.984049 (+   718us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:57.984306 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:13:57.996131 (+ 11825us) write_op.cc:312] APPLY: finished
0709 12:13:58.003686 (+  7555us) log.cc:844] Serialized 41 byte log entry
0709 12:13:58.003908 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:58.004030 (+   122us) write_op.cc:454] Released schema lock
0709 12:13:58.004096 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:58.004508 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:58.004581 (+    73us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1626693,"reported_tablets":17,"spinlock_wait_cycles":24832,"child_traces":[["op",{"apply.queue_time_us":142513,"apply.run_cpu_time_us":2988,"apply.run_wall_time_us":39302,"num_ops":4,"prepare.queue_time_us":292384,"prepare.run_cpu_time_us":108943,"prepare.run_wall_time_us":235505,"raft.queue_time_us":216917,"raft.run_cpu_time_us":28918,"raft.run_wall_time_us":173914,"replication_time_us":686369,"spinlock_wait_cycles":35392896,"thread_start_us":602494,"threads_started":4,"wal-append.queue_time_us":336894}]]}
I20260709 12:13:58.410928  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.413414  6526 raft_consensus.cc:3055] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.413887  6526 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:58.386044  6529 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.386142  6484 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.394326  5865 consensus_queue.cc:260] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.384979  6099 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.388648  6463 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.395190  6122 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.423852  6122 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.357831  6404 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.389114  6332 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.427201  6289 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.427570  4332 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:58.417034  6529 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.418839  6099 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:58.432530  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45692.4us
I20260709 12:13:58.437915  5030 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:58.418876  5865 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.427243  6484 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:58.445859  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 91189us
I20260709 12:13:58.444283  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:58.430094  6167 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.454443  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
W20260709 12:13:58.494582  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 47086us
I20260709 12:13:58.501194  4407 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:13:58.502806  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:13:58.504209  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 59077us
W20260709 12:13:58.506664  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 60220us
I20260709 12:13:58.507315  6050 raft_consensus.cc:697] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:58.508921  6050 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.515033  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.477840  6465 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.461004  6323 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:13:58.528728  4407 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.505846  6332 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:13:58.525995  6549 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:58.522533  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:58.525738  6521 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.555452  6268 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:58.556229  6268 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.564391  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.565975  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:13:58.569164  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.570114  6414 raft_consensus.cc:2764] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:58.573211  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:58.568931  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.577741  4515 raft_consensus.cc:2393] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:58.570947  6414 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.579504  6414 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.581112  4481 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:58.582518  6414 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.583369  4332 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.583720  6268 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.584280  6268 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.584744  4332 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.586124  4332 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.587148  6556 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.587777  6556 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.589665  6099 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.592270  5022 raft_consensus.cc:2393] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:58.539559  6528 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:13:58.595472  6528 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.595860  6528 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:58.596674  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:58.588289  5940 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.536948  6463 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.600857  6463 raft_consensus.cc:697] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:58.486075  6526 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.604199  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:58.615914  5025 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:58.612329  6463 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.619824  4330 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.620966  6167 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.621424  6167 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:13:58.621950  6167 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.628584  4506 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:58.629279  6270 raft_consensus.cc:2764] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:13:58.605178  6526 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.608789  4262 catalog_manager.cc:5697] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.636958  4262 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193), VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194), VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195), VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:13:58.606254  6548 log.cc:927] Time spent T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:13:58.642597  6520 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.643186  6520 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.641628  4262 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.647450  6520 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.648221  5940 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.614913  6407 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.647961  4262 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.650061  6414 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:58.651291  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 55976.3us
I20260709 12:13:58.651014  4262 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.602962  6484 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.652590  6521 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:58.652565  4262 catalog_manager.cc:5697] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 6, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.653841  6521 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.654364  4262 catalog_manager.cc:5697] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:58.656312  6167 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:13:58.652791  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 66839.5us
I20260709 12:13:58.657922  4481 leader_election.cc:400] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5.
I20260709 12:13:58.658373  4481 leader_election.cc:403] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.660089  6270 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5.
I20260709 12:13:58.660701  6332 consensus_queue.cc:1048] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:58.661020  4332 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.661842  6407 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.662431  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.663353  6407 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.664716  4332 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.657637  4262 catalog_manager.cc:5697] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.665627  6407 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.666128  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:13:58.667551  4262 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.675180  4262 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.681627  4262 catalog_manager.cc:5697] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.672299  6407 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.669149  6484 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.678682  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:58.688230  4515 raft_consensus.cc:2393] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:58.682507  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:58.692538  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.698061  4362 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.701135  5025 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:58.701296  4362 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:58.703055  5865 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:58.704087  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.703315  4330 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.703737  4262 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.705766  6407 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:58.706259  4362 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.706440  6407 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:58.706182  6528 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.707791  6407 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.534533  4407 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:58.709945  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 175533us
I20260709 12:13:58.711346  5940 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.713810  4332 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.715583  4262 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:58.728549  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 254211us
I20260709 12:13:58.728820  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.732034  4515 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:58.733671  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:58.737262  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.746392  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.753482  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.744107  6167 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:58.757683  6557 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.758148  4360 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:58.759188  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.759912  4361 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.761089  4358 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:58.763619  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.764567  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.764614  4365 raft_consensus.cc:2393] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:58.765578  4435 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:58.767632  4432 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:58.770637  4262 catalog_manager.cc:5697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:58.774070  4362 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
W20260709 12:13:58.774392  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 103977us
I20260709 12:13:58.775728  4432 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:58.774477  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.779526  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:58.780777  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 109152us
I20260709 12:13:58.781726  4332 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.779633  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.783742  4436 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.784705  4262 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.780339  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.786145  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.789753  4440 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:58.792183  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.792814  4366 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.792826  4332 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.796262  4437 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:58.801046  4438 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:58.802739  4439 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:13:58.799149  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.808179  4262 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.811591  4361 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:13:58.814855  4436 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
W20260709 12:13:58.816707  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.816550  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 341115us
I20260709 12:13:58.787755  6332 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.820417  4262 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:58.786149  6537 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.822690  4432 raft_consensus.cc:1240] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:58.822702  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.819989  4405 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.797788  5940 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.795711  6167 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.815812  6268 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.830132  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.828275  4515 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:58.816932  6557 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:13:58.831640  4262 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.836457  4436 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:13:58.833175  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.840371  6526 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.828655  6332 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.843295  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:58.843197  5940 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.843231  6332 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:58.826043  4366 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:13:58.844691  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.845850  5940 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.851819  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:58.846876  6137 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.853525  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.855027  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.857188  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.857486  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.857782  4434 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.859274  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:58.815186  6050 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:58.835088  6270 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:58.846206  6550 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:58.827054  6563 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.830724  6167 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:58.875281  6563 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.877758  6563 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.878365  6526 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:58.879187  4439 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:58.879319  6553 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.879787  6526 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.879988  6553 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.880347  6526 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:58.611094  6546 consensus_queue.cc:1175] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f6e8442c230466296caa54a80810609" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:58.882436  6526 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.883249  6287 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.883718  6287 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:58.885720  6287 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.870244  6484 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:58.875300  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.860134  4405 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.865278  6332 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.850211  4262 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:58.868675  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.869532  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.891618  4440 raft_consensus.cc:2393] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:58.890277  4435 raft_consensus.cc:2468] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:13:58.897481  4508 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.902184  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.899780  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.903556  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.915489  4262 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
W20260709 12:13:58.897249  6568 log.cc:927] Time spent T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:13:58.910697  4510 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:13:58.888461  6167 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.922595  4364 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:58.926079  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.924749  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:58.927492  4434 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:13:58.925297  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:58.901084  6563 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.925665  4262 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:13:58.933979  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.935071  4434 raft_consensus.cc:2393] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:58.830941  6537 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:58.938833  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:13:58.941623  4262 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:58.944288  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:58.945147  4438 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:13:58.944694  4262 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.948836  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.949615  4361 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:13:58.920536  6414 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.951476  4262 catalog_manager.cc:5697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.959748  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:58.933125  6463 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:58.963945  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.937712  6137 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.964442  4262 catalog_manager.cc:5697] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:58.941457  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:58.961329  6099 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:13:58.977356  4262 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 2, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:13:58.948702  6521 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.915234  6553 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:58.995312  6526 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.941237  6289 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:13:59.017253  6332 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.942339  6534 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:13:59.021958  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.007565  6521 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.026448  4365 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [3.3-5.5]
I20260709 12:13:59.023195  6529 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:13:59.013053  6414 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:59.048297  6414 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.022624  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:59.051580  4438 raft_consensus.cc:606] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.052033  4438 raft_consensus.cc:614] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:59.053267  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.054157  4438 raft_consensus.cc:2410] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:59.056174  6537 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.056797  6521 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.022323  6332 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.013423  6526 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:59.064284  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:13:59.056293  6571 log.cc:927] Time spent T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:13:59.072850  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:58.997083  6463 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.079710  4361 raft_consensus.cc:1275] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:13:59.082283  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.081449  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 127388us
I20260709 12:13:59.013942  6137 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.063381  6414 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.080880  6526 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.094558  4438 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.062716  6270 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:13:59.081722  6561 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.108537  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.109472  4437 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:59.110956  4997 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:13:59.128247  4515 raft_consensus.cc:1240] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:59.139901  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.141172  4437 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:59.142283  4513 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 7. Current term is 8. Ops: []
I20260709 12:13:59.150317  6137 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.173060  6167 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.180338  6332 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:59.181185  6332 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:59.193306  6463 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.125120  6424 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:59.208014  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 72506.6us
I20260709 12:13:59.208811  4407 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.212436  4364 raft_consensus.cc:2410] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:59.213860  6167 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.215370  6407 consensus_queue.cc:1059] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:59.216805  6407 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.217274  6407 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:59.218398  6407 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.229727  4437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:59.230522  4437 raft_consensus.cc:606] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.230943  4437 raft_consensus.cc:614] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:59.123617  6561 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.204257  6424 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.220592  6537 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.234211  6268 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:13:59.252513  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.259223  4513 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:59.244501  6563 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:59.261883  6268 consensus_queue.cc:1243] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:59.264225  4506 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:59.256656  6537 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.255887  6424 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.276161  4437 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:59.280494  4508 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:59.256026  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 167175us
I20260709 12:13:59.282083  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.277614  4438 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:13:59.259882  6407 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.289031  5022 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:59.286131  6137 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:13:59.290783  6268 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:59.291193  4437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:59.281885  6484 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.307740  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.295374  4437 raft_consensus.cc:606] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.327401  4407 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.288483  6563 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:13:59.329083  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46228.2us
I20260709 12:13:59.285128  6526 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.339691  6265 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:13:59.321398  6414 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:59.290820  6521 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.335242  6588 consensus_queue.cc:1059] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:13:59.307901  6584 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.335321  6537 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.341939  4407 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:13:59.355537  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 43997.9us
I20260709 12:13:59.355563  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.308358  6576 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:13:59.363665  4481 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.365658  6561 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.367098  6583 consensus_queue.cc:1059] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:13:59.375389  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.354022  6584 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:59.379062  4407 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.340760  6137 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:13:59.384788  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.369489  6550 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:59.389860  6583 raft_consensus.cc:2804] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:13:59.391124  6583 raft_consensus.cc:697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.392467  6583 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.395200  6588 raft_consensus.cc:3055] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:13:59.395776  6588 raft_consensus.cc:740] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.363512  6122 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:13:59.402382  6521 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:59.403179  6592 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.403618  6592 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.404588  6592 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.406096  6592 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.412065  6526 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.415370  6590 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.416110  6590 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.381938  6584 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.416685  6590 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.428716  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:59.429452  4513 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.362651  6563 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.399621  6414 raft_consensus.cc:697] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.396989  6588 consensus_queue.cc:260] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.441812  6588 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:59.397959  6424 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.447842  6591 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.450244  6537 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.450861  6537 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.453859  4513 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:13:59.461218  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.467674  6268 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:59.461617  6596 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.485056  6268 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.474828  6332 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.487177  4366 raft_consensus.cc:3060] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:59.486892  6332 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.488646  6268 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.488896  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:59.489387  6332 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.460623  5940 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.490275  5940 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.496945  4366 raft_consensus.cc:2468] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
W20260709 12:13:59.477795  6594 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:13:59.500976  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 137414us
I20260709 12:13:59.467662  6528 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.503353  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.505128  4513 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:13:59.485750  6596 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.503773  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.513450  4508 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:59.463429  6424 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:13:59.509631  6602 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:59.467212  6414 consensus_queue.cc:237] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.521227  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:59.522068  5027 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:13:59.521589  4433 raft_consensus.cc:2410] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:59.478042  6590 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.533819  4479 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.539700  6576 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:59.545291  6576 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:13:59.545739  6576 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.545871  6407 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.557328  6605 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.558099  6605 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.562574  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.555526  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:59.546803  6407 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.568008  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:59.570433  4510 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.575937  5940 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.577199  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:59.578037  4511 raft_consensus.cc:2393] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 5: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:13:59.551616  6584 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.586697  4437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:13:59.587682  4437 raft_consensus.cc:606] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.588166  4437 raft_consensus.cc:614] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:59.595528  6402 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:13:59.596161  6402 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.596927  4432 raft_consensus.cc:1240] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.596705  6407 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.601790  6402 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.605859  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:59.606421  4997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.608839  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.609759  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.610390  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:59.611217  4434 raft_consensus.cc:3060] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.623847  4997 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.625085  6332 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:59.628212  6564 log.cc:927] Time spent T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.741s	user 0.001s	sys 0.002s
W20260709 12:13:59.628212  6604 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:13:59.629235  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:13:59.629870  6590 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.630497  6558 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.631256  6534 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.631791  6534 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.632737  6534 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.634943  6270 consensus_queue.cc:1048] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:59.636379  6584 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:13:59.579685  6605 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.644263  6595 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.647192  4510 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:59.580470  6596 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.651908  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:13:59.673664  6600 log.cc:927] Time spent T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:13:59.783279  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 128001us
I20260709 12:13:59.789486  4513 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:13:59.638899  4997 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.785830  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.787854  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.791415  4434 raft_consensus.cc:2468] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:59.794287  4996 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.794921  4407 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.796324  4506 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:59.817253  4514 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.796510  6484 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.819566  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.796268  6099 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.820658  4506 raft_consensus.cc:2410] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:59.821120  5025 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:59.788679  6595 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.822350  6595 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.823490  6590 raft_consensus.cc:2804] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:13:59.823767  6595 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.824082  6590 raft_consensus.cc:697] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:59.824191  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.824585  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.816471  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.825167  6590 consensus_queue.cc:237] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:13:59.827769  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.829209  6553 raft_consensus.cc:2804] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.817977  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.829421  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:13:59.829862  6553 raft_consensus.cc:697] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:13:59.830268  6597 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:59.799688  6407 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:13:59.830847  6553 consensus_queue.cc:237] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.830919  6597 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.833086  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:13:59.832988  6597 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:13:59.834450  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 200038us
I20260709 12:13:59.799424  6402 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.810918  6576 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.835214  6402 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.836583  6576 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.834599  6558 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.839571  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.840252  4432 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:59.812657  4508 raft_consensus.cc:1240] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:59.841012  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 46789.8us
I20260709 12:13:59.843382  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:59.847184  4435 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.854593  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:59.855547  4438 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.856741  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.858563  4366 raft_consensus.cc:1240] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:13:59.858685  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.860817  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.864394  4366 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.784504  6167 raft_consensus.cc:3055] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:13:59.867909  4362 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:59.869236  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:13:59.871954  4362 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.877635  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:13:59.879297  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.850473  6609 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.161s	user 0.005s	sys 0.000s
I20260709 12:13:59.881479  4433 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:13:59.882755  4432 raft_consensus.cc:1240] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.831655  6407 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:13:59.884277  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:59.904028  4438 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:13:59.843019  6584 raft_consensus.cc:2764] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:59.900967  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:59.913623  4358 raft_consensus.cc:3060] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.909094  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.919306  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.910199  4361 raft_consensus.cc:1275] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:59.910634  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.909094  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.912086  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:13:59.922142  4511 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:13:59.922778  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.923108  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:59.923731  4360 raft_consensus.cc:2376] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6. Re-sending same reply.
W20260709 12:13:59.923826  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 285138us
I20260709 12:13:59.905979  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:59.874567  6167 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:13:59.925325  4406 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.889575  5940 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.927680  4435 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:59.890079  6537 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:13:59.933336  4481 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:13:59.935885  4358 raft_consensus.cc:2468] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:13:59.940701  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:13:59.925277  6402 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:13:59.931079  6584 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.940433  5940 raft_consensus.cc:697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:13:59.943800  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.950734  4358 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:13:59.935638  6332 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.946671  4331 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:13:59.955327  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:13:59.938580  6137 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.961673  4433 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:59.942945  6521 raft_consensus.cc:2804] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.929698  6576 consensus_queue.cc:1059] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:13:59.968465  4441 raft_consensus.cc:1240] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 7. Current term is 8. Ops: []
I20260709 12:13:59.969439  4436 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.970281  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:13:59.946957  6584 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.948271  6424 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.963581  6137 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.984277  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:13:59.987478  4358 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:13:59.989359  4436 raft_consensus.cc:1275] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:13:59.968616  6268 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.971086  6332 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.983232  6584 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.982722  6521 raft_consensus.cc:697] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:13:59.985872  6545 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.989019  6137 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.981318  6561 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:13:59.981997  6323 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:13:59.967311  6167 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:00.023267  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 59001.1us
I20260709 12:13:59.991580  6424 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:00.032276  6521 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:00.035719  6610 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:14:00.035888  6404 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:00.017959  5940 consensus_queue.cc:237] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:00.044920  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.026324  4331 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.025120  4997 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.052309  4331 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.054306  6289 raft_consensus.cc:3055] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:00.056149  6553 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:00.007325  6589 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 12:14:00.056253  6404 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.056891  6557 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:00.056752  6588 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:00.057682  6332 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.065503  6424 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:00.024673  6402 consensus_queue.cc:1059] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:14:00.093494  6402 consensus_queue.cc:1243] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:00.067708  6559 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.094298  6559 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.096779  6559 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:00.079274  6289 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:00.073395  4997 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.081219  6557 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:00.082880  6613 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:00.017553  6545 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:00.091547  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.106743  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.108771  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:00.110741  4362 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:00.116986  4440 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:00.081432  6268 consensus_queue.cc:1059] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:14:00.129246  6289 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.130779  6289 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.111299  6624 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.152997  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.123492  6614 consensus_queue.cc:1048] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:00.140249  6592 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:14:00.160820  6407 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:00.209704  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:00.164253  6557 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:00.219681  6621 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:14:00.220224  6557 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:00.221781  6620 log.cc:927] Time spent T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:14:00.228726  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.239302  4364 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:14:00.242419  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 88642.6us
I20260709 12:14:00.247051  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:00.248767  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:00.249544  4434 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:00.250923  4997 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:00.232219  6404 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:00.276082  4364 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:14:00.295258  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 66600.2us
W20260709 12:14:00.299409  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 67875us
I20260709 12:14:00.312045  4332 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.334359  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.336372  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.337333  4364 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:00.342733  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:00.343438  4361 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.353451  6407 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.356220  6552 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.367698  6167 raft_consensus.cc:3060] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:00.379240  6613 raft_consensus.cc:3055] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:00.379949  6613 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:00.381182  6613 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.361789  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:00.398671  6608 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.607s	user 0.001s	sys 0.009s
I20260709 12:14:00.382927  6613 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.415967  4511 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:14:00.417367  4511 pending_rounds.cc:85] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 4
I20260709 12:14:00.419158  6099 raft_consensus.cc:3055] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:00.419740  4511 pending_rounds.cc:107] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:14:00.419754  6099 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:00.424361  6099 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:00.426496  6099 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.427037  4511 raft_consensus.cc:2889] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.429520  6323 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:00.430153  6323 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.432430  6559 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:00.436699  6323 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:00.422219  6558 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.438717  6558 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.439152  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:00.439723  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.439841  5025 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:00.446437  4440 pending_rounds.cc:85] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Aborting all ops after (but not including) 2
I20260709 12:14:00.446908  4440 pending_rounds.cc:107] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:00.450059  4440 raft_consensus.cc:2889] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.439200  6558 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.273145  6630 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:00.506013  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.538849  4361 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:00.542301  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.545106  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.275990  6137 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:00.341876  6545 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:00.541795  6625 log.cc:927] Time spent T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:14:00.565204  6559 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:00.276757  6404 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:00.361418  6552 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:00.591195  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.597306  4432 raft_consensus.cc:2368] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:00.664435  4512 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:14:00.664878  4512 pending_rounds.cc:85] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 2
I20260709 12:14:00.665124  4512 pending_rounds.cc:107] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:14:00.665362  4512 raft_consensus.cc:2889] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.667917  4363 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:00.672508  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 360512us
I20260709 12:14:00.674191  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:00.651710  6289 consensus_meta.cc:287] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.004s
W20260709 12:14:00.731840  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.736145  6615 log.cc:927] Time spent T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:14:00.671597  6534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.001s	sys 0.024s
W20260709 12:14:00.737154  6534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.002s	sys 0.024s
W20260709 12:14:00.737510  6629 log.cc:927] Time spent T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.398s	user 0.000s	sys 0.000s
W20260709 12:14:00.739153  6634 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:14:00.596841  6559 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:00.782529  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 108397us
I20260709 12:14:00.784905  4332 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.787015  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.787737  4363 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:00.791956  6607 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.792603  6607 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:00.676553  6605 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:14:00.812086  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.817610  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.818325  4359 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:14:00.820307  4480 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.824911  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:00.843171  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:00.847740  4407 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.793983  6552 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:00.853412  4332 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:00.862242  4363 raft_consensus.cc:1275] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:00.792613  6559 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:00.869642  4359 raft_consensus.cc:1275] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:14:00.824214  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:00.849836  6620 log.cc:927] Time spent T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:14:00.865074  6643 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.845212  6630 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:00.883368  4360 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:00.848976  5940 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.884073  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.890452  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:00.895504  4512 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
W20260709 12:14:00.873761  6597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.002s	sys 0.005s
I20260709 12:14:00.869585  6552 raft_consensus.cc:2764] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:00.868448  6424 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.872752  6402 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.909561  4359 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:00.896210  6648 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.914813  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:00.915743  4363 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
W20260709 12:14:00.953312  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.905838  6597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.003s	sys 0.006s
I20260709 12:14:00.897348  6607 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:00.960108  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 80111.5us
W20260709 12:14:00.972054  6617 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:14:00.901371  6553 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:00.876199  6407 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:00.922201  6465 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:00.960000  6332 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:14:01.010104  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 154944us
I20260709 12:14:01.031894  4407 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:00.922430  6424 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.005775  6404 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:00.986940  6641 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 12:14:01.020762  6323 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.073244  4434 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:14:01.078332  6651 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
W20260709 12:14:01.079977  6649 log.cc:927] Time spent T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:14:01.082011  6653 log.cc:927] Time spent T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:14:01.083670  6652 log.cc:927] Time spent T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:14:01.083879  6662 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:01.084738  6552 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:01.086184  6552 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:01.024120  6671 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:14:01.086680  6552 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.088939  6552 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.089895  6424 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:01.091933  6639 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.499s	user 0.000s	sys 0.006s
I20260709 12:14:01.098410  6590 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.111867  6584 consensus_meta.cc:287] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 1.098s	user 0.007s	sys 0.004s
I20260709 12:14:01.112429  6584 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.113659  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.114056  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.114364  5027 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:01.114583  6584 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:01.114921  4512 raft_consensus.cc:1240] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.116446  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.034178  6465 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.118750  6465 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.004964  6553 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.121043  6553 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:01.054800  6137 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.121992  4432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37854 (request call id 1255) took 1167 ms. Trace:
I20260709 12:14:01.122478  4432 rpcz_store.cc:276] 0709 12:13:59.954127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.955095 (+   968us) service_pool.cc:224] Handling call
0709 12:14:01.121758 (+1166663us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54000e56d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:14:01.121887 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429526400}
W20260709 12:14:01.123490  6099 consensus_meta.cc:287] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
I20260709 12:14:01.126452  4508 raft_consensus.cc:1275] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.057070  6332 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.056105  6601 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.130896  6590 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.158452  6590 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.151284  4331 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.168473  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.169317  4364 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
W20260709 12:14:01.140319  6558 consensus_meta.cc:287] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.003s
I20260709 12:14:01.170238  6558 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.174340  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.180546  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
W20260709 12:14:01.137580  6613 consensus_meta.cc:287] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
I20260709 12:14:01.187914  4515 raft_consensus.cc:2410] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:14:01.137693  6557 consensus_meta.cc:287] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.001s
I20260709 12:14:01.194657  6558 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:01.194979  6638 log.cc:927] Time spent T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
W20260709 12:14:01.197003  6167 consensus_meta.cc:287] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.005s
I20260709 12:14:01.163422  6407 consensus_queue.cc:1059] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:14:01.187819  6671 consensus_queue.cc:1048] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:14:01.200642  6670 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:01.126474  6323 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.203194  6332 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.204823  6323 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.205463  4358 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:01.205669  5022 raft_consensus.cc:2393] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:01.160346  6588 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:01.211685  6588 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.214020  6588 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.220691  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.176643  6404 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.221644  4437 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:01.228238  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.228940  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:01.237921  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 183231us
I20260709 12:14:01.239289  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:01.241211  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 54138.5us
I20260709 12:14:01.237612  6407 consensus_queue.cc:1243] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:01.245685  5940 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:01.246160  5024 raft_consensus.cc:2368] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:01.248456  4330 leader_election.cc:400] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:01.248797  4330 leader_election.cc:403] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.248924  4407 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.256196  4407 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.258749  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:01.260043  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.260897  4361 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:01.262027  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:01.264556  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.266273  4437 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.271749  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.250125  6630 raft_consensus.cc:3060] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.257531  6265 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.274868  4331 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.280488  4407 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.282385  4508 raft_consensus.cc:1240] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.283241  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.293247  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.297122  4407 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.297930  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.270231  6674 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:01.283257  6623 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.300940  6528 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.303406  6613 consensus_queue.cc:1059] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:01.304457  6613 raft_consensus.cc:3055] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.304813  6613 raft_consensus.cc:740] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:01.292022  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.305692  6613 consensus_queue.cc:260] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.306949  6613 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.310393  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:01.319145  6671 raft_consensus.cc:3055] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.319598  6671 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:01.320410  6671 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.321442  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.321709  6671 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.322851  6670 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.314307  6590 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.324177  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.325126  6265 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.325640  6674 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:01.326589  6265 raft_consensus.cc:993] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:01.329871  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.331532  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.332756  4407 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:01.332904  6666 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:01.334208  4407 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.334179  6666 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.335927  6528 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.326582  6674 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.336313  6528 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:01.336457  6666 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.336748  6528 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.336984  6666 consensus_queue.cc:1048] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:01.338182  4407 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:01.339147  6265 raft_consensus.cc:1081] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:01.315279  6669 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.341434  4407 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.340899  5940 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.342756  6669 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.351704  4363 raft_consensus.cc:1275] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.353544  4332 leader_election.cc:400] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:01.353935  4332 leader_election.cc:403] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.356163  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.357262  4363 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:01.351116  4481 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:01.348369  6678 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.363123  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:01.360677  4481 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:01.356689  6669 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.364616  6167 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.381469  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.366895  6323 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.379508  4357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:01.367661  6643 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.368738  6678 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.397320  4434 raft_consensus.cc:1275] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.399983  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.376245  6521 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.390120  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.391812  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.392573  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.395165  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:01.412288  4509 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.386003  4357 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.413074  4357 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.401320  6332 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.423552  5940 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:01.399840  6643 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.429379  6643 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.431638  6630 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) with higher term. Message: Invalid argument: T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:01.400117  6678 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.438601  4361 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:01.439872  6670 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.442637  6670 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.443377  6404 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:01.443959  6404 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.445772  6670 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.446153  6404 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.448956  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.449690  4440 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:01.449862  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.452040  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:01.454815  4365 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:01.456215  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.456823  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.460170  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.460817  4511 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:01.384965  6323 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.469285  6323 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.471127  4997 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.473688  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.478379  6167 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) with higher term. Message: Invalid argument: T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6.
I20260709 12:14:01.479494  6636 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.479916  6636 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.480261  6636 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.485404  4332 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.485541  6404 consensus_queue.cc:1048] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:01.487133  6521 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:01.487753  6521 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.489702  4360 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:01.490499  6521 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.461333  4357 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.440846  4509 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:01.438632  6528 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.487743  6678 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:01.525405  4330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.526549  5940 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:01.527218  5940 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.528546  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.530274  5940 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.531764  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.532771  6623 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:01.535290  6669 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.538899  4366 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.553560  5024 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:01.554251  6323 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.554805  4357 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.542876  4997 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.572642  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:01.573256  4438 raft_consensus.cc:3055] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.573558  4438 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:01.573508  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:01.544198  6521 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:01.548488  4509 raft_consensus.cc:1275] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.577178  4434 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:01.550642  6678 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.514779  4437 raft_consensus.cc:2468] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:01.556376  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.557348  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:01.581485  4511 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.581636  4433 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:01.526602  6528 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.558837  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.575448  4263 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 5 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.559671  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.560021  6669 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.538401  6636 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.574687  4358 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.579277  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.583194  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:01.619822  4357 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.621528  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:01.610809  6529 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:14:01.611860  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:01.634704  4357 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:01.612995  4263 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.610126  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:01.611510  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:01.637703  4440 raft_consensus.cc:2410] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:01.585026  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:01.638242  4361 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.579389  6644 raft_consensus.cc:2804] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:01.585839  6596 raft_consensus.cc:2764] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:01.585374  6521 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.579684  6588 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:01.580083  4438 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.619834  4434 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:01.615119  4407 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.640872  4263 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.650411  4361 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:01.660993  4438 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.662425  4263 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.673084  4263 catalog_manager.cc:5697] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.677171  4263 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.683028  4358 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:01.688534  4511 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:01.626768  6636 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:01.702461  4438 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:01.700047  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
W20260709 12:14:01.702590  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 87565.4us
I20260709 12:14:01.703263  4434 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:01.644265  6687 log.cc:927] Time spent T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:01.638830  6529 consensus_queue.cc:1243] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:01.631873  6671 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:14:01.711747  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 80441.3us
I20260709 12:14:01.659799  6607 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.717072  6607 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.717669  6607 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.695957  4263 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193), VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194), VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195), VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.719341  4263 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.721220  4263 catalog_manager.cc:5697] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.615094  6584 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:14:01.644011  6605 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:01.733788  4434 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:01.636718  6597 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:14:01.740617  4406 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.689445  6588 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.727581  6552 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:01.754880  4263 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.757004  6588 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.764629  4263 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.730962  6644 raft_consensus.cc:697] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:01.779800  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.793548  4263 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:01.796900  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 154573us
I20260709 12:14:01.801316  4512 raft_consensus.cc:1275] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.730247  6671 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:01.810212  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 72298us
I20260709 12:14:01.808238  4262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 254) took 7462 ms. Trace:
I20260709 12:14:01.812294  4263 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 4, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:01.811550  4407 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:01.747757  6605 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:01.791056  6601 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:01.792052  6684 log.cc:927] Time spent T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:01.771884  6588 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:01.827116  6588 consensus_queue.cc:1243] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer 6f6e8442c230466296caa54a80810609 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:01.834278  4407 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:14:01.839645  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 68513.6us
I20260709 12:14:01.841281  4406 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.812917  4262 rpcz_store.cc:276] 0709 12:13:54.335927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.340877 (+  4950us) service_pool.cc:224] Handling call
0709 12:14:01.797997 (+7457120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:59.252369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:59.253025 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:59.253071 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:13:59.253092 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:59.289365 (+ 36273us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:59.289425 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:59.289449 (+    24us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:13:59.293371 (+  3922us) tablet.cc:701] Row locks acquired
0709 12:13:59.293395 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:13:59.293593 (+   198us) write_op.cc:270] Start()
0709 12:13:59.293745 (+   152us) write_op.cc:276] Timestamp: P: 1783599239293536 usec, L: 0
0709 12:13:59.293778 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:13:59.371150 (+ 77372us) log.cc:844] Serialized 10439 byte log entry
0709 12:13:59.934450 (+563300us) op_driver.cc:464] REPLICATION: finished
0709 12:14:00.503328 (+568878us) write_op.cc:301] APPLY: starting
0709 12:14:00.544638 (+ 41310us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:00.833713 (+289075us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:00.857135 (+ 23422us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:01.089556 (+232421us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:01.089923 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:14:01.089977 (+    54us) write_op.cc:312] APPLY: finished
0709 12:14:01.090688 (+   711us) log.cc:844] Serialized 176 byte log entry
0709 12:14:01.228153 (+137465us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124afe30ac 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b
0709 12:14:01.347931 (+119778us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.365507 (+ 17576us) write_op.cc:454] Released schema lock
0709 12:14:01.369026 (+  3519us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:01.424964 (+ 55938us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800373420. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b000522 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:14:01.425078 (+   114us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.425107 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1176431,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":339729,"apply.run_cpu_time_us":54697,"apply.run_wall_time_us":1050585,"num_ops":26,"prepare.queue_time_us":189854,"prepare.run_cpu_time_us":9514,"prepare.run_wall_time_us":175948,"raft.queue_time_us":333090,"raft.run_cpu_time_us":8515,"raft.run_wall_time_us":273022,"replication_time_us":629588,"spinlock_wait_cycles":27353216,"thread_start_us":884032,"threads_started":5,"wal-append.queue_time_us":381344,"wal-append.run_cpu_time_us":54352,"wal-append.run_wall_time_us":1378893}]]}
I20260709 12:14:01.828853  6584 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:01.892656  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 58471.9us
I20260709 12:14:01.891562  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.844009  6528 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:01.891023  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 49816.7us
I20260709 12:14:01.842011  6552 raft_consensus.cc:697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:01.902576  4406 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:01.895246  6137 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.910028  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:01.912847  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:01.900485  6666 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:01.917213  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:01.917891  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:01.906243  6521 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:01.917098  6332 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:01.862044  6644 consensus_queue.cc:237] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.900105  6584 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:01.981824  6670 consensus_queue.cc:1048] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:01.989064  6605 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:01.990317  6688 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:01.936681  6137 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.936802  6666 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
W20260709 12:14:02.005671  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 103344us
I20260709 12:14:02.008987  4996 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.966220  6700 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:01.962411  6528 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:02.014366  4509 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:02.022294  4406 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:02.022796  4332 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:01.976030  6332 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:02.025048  6690 log.cc:927] Time spent T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:14:02.026593  6332 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:02.027997  6557 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.028519  6659 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.031870  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:02.000828  6137 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.036796  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:02.036965  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:02.038328  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:02.039023  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:02.041734  4365 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:02.043277  4362 pending_rounds.cc:85] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 1
I20260709 12:14:02.057351  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.044788  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.048100  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.059816  4362 pending_rounds.cc:107] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:02.060918  4365 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:14:02.061250  4362 raft_consensus.cc:2889] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:02.061995  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 94406.9us
I20260709 12:14:02.064323  4441 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:02.072077  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:02.076741  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.018658  6628 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.018296  6705 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.020816  6671 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:02.046926  6137 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.975313  6552 consensus_queue.cc:237] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:02.122702  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 64621.3us
I20260709 12:14:02.127262  4331 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:02.028481  6557 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.041802  6701 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.087754  6404 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.130496  4366 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:02.030503  6706 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:14:02.132135  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:02.117044  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 99251.1us
I20260709 12:14:02.136688  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.029006  6659 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.092726  6709 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.125898  6707 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.221975  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:02.020524  6700 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.126338  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:02.127282  6666 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.118927  6705 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:02.464063  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 441297us
I20260709 12:14:02.485087  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:02.222316  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 161807us
W20260709 12:14:02.480252  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 445421us
I20260709 12:14:02.284178  4365 pending_rounds.cc:85] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 2
W20260709 12:14:02.462975  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 425006us
W20260709 12:14:02.227550  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 142902us
W20260709 12:14:02.231223  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 91059.9us
I20260709 12:14:02.496001  4365 pending_rounds.cc:107] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:14:02.503949  4365 raft_consensus.cc:2889] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.293130  6648 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:02.141180  6699 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.365s
I20260709 12:14:02.142668  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:02.450030  6715 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.493569  6323 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.449810  6724 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.569087  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:02.184715  6414 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.509081  4507 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.562009  6584 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:02.574916  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 59452.5us
W20260709 12:14:02.519074  6607 consensus_meta.cc:287] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.001s
W20260709 12:14:02.575858  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59322us
I20260709 12:14:02.511350  6669 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.150844  6404 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.619544  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:02.146461  6701 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:02.627755  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 58754.9us
W20260709 12:14:02.628214  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 54935.9us
I20260709 12:14:02.575649  6648 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:02.634073  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:02.279284  6528 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.595014  6557 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:02.595211  6552 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:14:02.638633  6704 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:02.645673  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:02.646459  4357 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.649412  6701 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:02.649947  6700 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:02.508247  6707 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.651350  6404 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:02.652086  6707 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:02.640046  6676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.013s
I20260709 12:14:02.625938  6659 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:02.616436  6715 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.658736  6715 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:02.664031  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.664764  4439 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:02.666967  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.667753  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.668012  4433 raft_consensus.cc:2410] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:14:02.668378  4436 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:02.670421  4332 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:02.671873  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:02.674029  6659 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.674423  6659 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:02.675599  6676 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.676029  6676 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.676376  6676 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.674506  4357 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:02.674882  6659 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.675642  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:02.687907  6648 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.689859  6715 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:02.624321  6738 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:02.639215  6584 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:02.699815  6718 log.cc:927] Time spent T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:14:02.705314  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 48640.8us
I20260709 12:14:02.716042  4406 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:02.632187  6669 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:02.624245  6414 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.733469  4481 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:02.630880  6607 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:02.749485  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:02.750298  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:02.771790  5030 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:02.775425  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:02.713658  6590 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:14:02.806245  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 90323.6us
I20260709 12:14:02.618021  6724 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.812753  4511 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 6: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
W20260709 12:14:02.807392  4432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.028s
W20260709 12:14:02.813934  4432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.028s
I20260709 12:14:02.782760  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:02.730813  6584 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:14:02.817723  4481 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:02.804834  6715 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:02.894173  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 78221.5us
I20260709 12:14:02.819211  6699 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.804270  6700 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:02.781746  6719 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:02.732613  6597 consensus_queue.cc:1059] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:14:02.804948  6706 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:02.917876  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 298901us
I20260709 12:14:02.920030  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:02.921737  4510 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.013s	sys 0.034s
I20260709 12:14:02.893338  6710 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:02.893836  6558 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:14:02.925396  4510 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.014s	sys 0.034s
I20260709 12:14:02.811928  6670 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:02.929944  6737 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.916501  6588 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.894068  6673 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.814498  6590 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.908866  6404 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.920030  6529 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:02.904872  6557 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.952709  6670 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:02.905947  6705 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:02.940348  6137 consensus_meta.cc:287] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.009s
I20260709 12:14:02.917187  6722 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:02.909570  6704 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:14:02.956864  6605 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:02.964529  6747 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:02.999706  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:02.948043  6558 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:02.921792  6706 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.976296  6712 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:02.948292  6710 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:02.919503  6719 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.964080  6404 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:03.019793  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 202362us
W20260709 12:14:03.023802  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 77056us
I20260709 12:14:03.018719  4513 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:14:03.043362  4513 pending_rounds.cc:85] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 3
I20260709 12:14:03.043771  4513 pending_rounds.cc:107] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:14:03.044129  4513 raft_consensus.cc:2889] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:02.968310  6529 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:02.975795  6557 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:03.014256  6744 log.cc:927] Time spent T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:14:03.048180  4997 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.042209  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.058759  4441 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.055778  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.063567  4432 raft_consensus.cc:1240] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:03.019636  6407 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.069504  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.996778  6659 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.074924  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:02.955075  6737 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.047281  6716 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.078889  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.079799  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.047549  6588 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.008190  6605 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.113844  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.115532  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:03.082147  6739 raft_consensus.cc:2804] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.119383  6766 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:02.999540  6722 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.063318  6597 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:14:03.089129  6669 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.128692  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.052085  6676 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.130616  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.131158  6714 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:14:03.131655  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 67223.2us
I20260709 12:14:03.114975  6700 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.051512  6738 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.015385  6747 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.105706  6715 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:03.107250  6607 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:03.119346  6756 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 12:14:03.078652  6407 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.157335  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:03.175873  5030 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.148343  6332 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.002970  6137 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.114496  6748 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:14:03.156352  6724 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.157464  6701 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:14:03.163136  6743 log.cc:927] Time spent T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:14:03.161158  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.123368  6588 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.210698  4363 raft_consensus.cc:2393] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:03.210783  6706 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.211683  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.212615  6588 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.212852  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.213577  4363 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:03.167557  6761 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.196511  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.213826  6670 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.198546  6332 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.214159  6761 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.214767  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.215467  6529 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.216022  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.216347  6761 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.175063  6700 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.216782  4366 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.207583  6605 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.199730  4331 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.217549  6710 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.176401  6775 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.218717  6775 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:03.207588  6757 log.cc:927] Time spent T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:14:03.208297  6698 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.149717  6766 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.224179  6698 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.226203  6766 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.226385  6698 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.227701  4357 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:03.227774  4365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1737) took 1158 ms. Trace:
W20260709 12:14:03.229357  4507 consensus_meta.cc:287] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.004s
I20260709 12:14:03.228260  4365 rpcz_store.cc:276] 0709 12:14:02.069511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.069694 (+   183us) service_pool.cc:224] Handling call
0709 12:14:02.070138 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:02.504854 (+434716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.504900 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:02.505760 (+   860us) log.cc:844] Serialized 52 byte log entry
0709 12:14:02.703473 (+197713us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:02.703515 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.227400 (+523885us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003566d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:14:03.227452 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.227495 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:03.227508 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.227717 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57882,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":26804,"spinlock_wait_cycles":491635584,"thread_start_us":197212,"threads_started":1,"wal-append.queue_time_us":303460}
I20260709 12:14:03.229723  6770 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.196754  6590 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.209996  6737 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.230398  6770 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.231596  6332 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:03.206323  6751 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:14:03.232213  6701 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:03.233656  6713 log.cc:927] Time spent T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.962s	user 0.005s	sys 0.000s
I20260709 12:14:03.174175  6715 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.234333  6701 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.220992  6747 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.221995  6699 raft_consensus.cc:3055] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.235524  6699 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:03.236176  6715 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.236451  6699 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.237253  6407 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.239346  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.239986  5025 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:03.202857  6719 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.222472  6558 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.217581  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:03.231841  6758 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:14:03.221911  6557 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.242702  4479 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.247452  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.229775  4507 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:03.249163  4366 raft_consensus.cc:2393] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.262044  5030 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:14:03.237798  6699 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.107695  6716 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.263617  4440 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 6: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:14:03.212949  6722 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.265926  4479 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.271973  4510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1815) took 1173 ms. Trace:
W20260709 12:14:03.264631  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 136109us
I20260709 12:14:03.276969  4510 rpcz_store.cc:276] 0709 12:14:02.090320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.090476 (+   156us) service_pool.cc:224] Handling call
0709 12:14:02.090815 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.091075 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:02.926009 (+834934us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.261432 (+335423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.261511 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:03.261573 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.261665 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.261824 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116505,"prepare.queue_time_us":562237,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":128799,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7354,"thread_start_us":1051366,"threads_started":3,"wal-append.queue_time_us":161870}
I20260709 12:14:03.171114  6738 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.265029  6588 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.283996  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.285696  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.153852  6714 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.285689  6588 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:14:03.289337  6741 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.391s	user 0.000s	sys 0.003s
I20260709 12:14:03.289615  6588 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.289788  6714 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.290867  4508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1814) took 1226 ms. Trace:
I20260709 12:14:03.291169  6738 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.291433  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.292104  4510 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:03.292841  6770 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.292994  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.293188  4364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1735) took 1233 ms. Trace:
I20260709 12:14:03.294094  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.286164  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.296432  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:14:03.285168  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 46662.2us
I20260709 12:14:03.291254  4508 rpcz_store.cc:276] 0709 12:14:02.064310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.064447 (+   137us) service_pool.cc:224] Handling call
0709 12:14:02.064753 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.660846 (+596093us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:02.661138 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.898347 (+237209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.898427 (+    80us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:02.898491 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.290653 (+392162us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b540011a654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:14:03.290697 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.290814 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2261,"prepare.queue_time_us":888,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":86189,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8632,"spinlock_wait_cycles":1370447616,"thread_start_us":159940,"threads_started":1,"wal-append.queue_time_us":378156}
I20260709 12:14:03.297816  4331 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.286381  4509 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:03.300133  4331 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.285516  6701 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.293618  4364 rpcz_store.cc:276] 0709 12:14:02.060048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.060180 (+   132us) service_pool.cc:224] Handling call
0709 12:14:02.060480 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.271529 (+211049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.271588 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.283129 (+ 11541us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.598398 (+315269us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:02.598604 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.744067 (+145463us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540019cdd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:14:02.744122 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.288626 (+544504us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:03.292981 (+  4355us) raft_consensus.cc:1685] finished
0709 12:14:03.293005 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.293133 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35187,"raft.queue_time_us":111032,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":422190080,"thread_start_us":305529,"threads_started":1,"wal-append.queue_time_us":438496}
I20260709 12:14:03.302341  6701 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.302814  6701 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.303161  6769 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.303566  6769 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.303915  6769 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.305547  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.277376  4507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47840 (request call id 1812) took 1230 ms. Trace:
I20260709 12:14:03.311930  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.280042  6739 raft_consensus.cc:697] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:03.317524  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:03.319320  6755 log.cc:927] Time spent T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:14:03.322729  6774 log.cc:927] Time spent T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:14:03.325268  6781 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 12:14:03.337095  4511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57688 (request call id 245) took 1466 ms. Trace:
I20260709 12:14:03.337543  4511 rpcz_store.cc:276] 0709 12:14:01.890871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.891052 (+   181us) service_pool.cc:224] Handling call
0709 12:14:03.336901 (+1445849us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54003025d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:14:03.337035 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113374976}
W20260709 12:14:03.339665  6726 log.cc:927] Time spent T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.768s	user 0.000s	sys 0.004s
I20260709 12:14:03.340979  4512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57688 (request call id 250) took 1318 ms. Trace:
I20260709 12:14:03.342245  4432 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:03.341346  4512 rpcz_store.cc:276] 0709 12:14:02.022863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.023137 (+   274us) service_pool.cc:224] Handling call
0709 12:14:02.023462 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.042735 (+ 19273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.042767 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.043522 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.463335 (+419813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:02.714182 (+250847us) log.cc:844] Serialized 14 byte log entry
0709 12:14:02.714702 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.714807 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.338898 (+624091us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:03.340721 (+  1823us) raft_consensus.cc:1685] finished
0709 12:14:03.340806 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.340926 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19153,"prepare.queue_time_us":190327,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":84083,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":30853,"spinlock_wait_cycles":58600832,"thread_start_us":520877,"threads_started":2,"wal-append.queue_time_us":377339}
I20260709 12:14:03.347810  6520 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:03.349923  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.351755  4510 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:03.311785  6407 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.354696  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:03.312942  6738 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.357311  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.357915  4366 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:03.358538  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.359263  5025 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
W20260709 12:14:03.360482  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 48645.8us
I20260709 12:14:03.363106  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.363934  6659 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.364019  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.365134  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:03.366761  6760 log.cc:927] Time spent T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:03.367182  6717 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.367622  6717 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.368005  6717 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.370590  6716 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.370594  6779 raft_consensus.cc:3060] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.372922  6700 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.375975  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:03.312808  4507 rpcz_store.cc:276] 0709 12:14:02.042595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.046654 (+  4059us) service_pool.cc:224] Handling call
0709 12:14:03.266412 (+1219758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:03.356596  6137 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.358767  6671 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:14:03.361328  6738 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.384305  6738 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.384768  4363 raft_consensus.cc:1275] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:03.374423  6584 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.357023  6407 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.392585  6407 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:03.393970  6736 log.cc:927] Time spent T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.814s	user 0.007s	sys 0.004s
I20260709 12:14:03.396369  6588 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.397627  4513 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:03.408775  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.409634  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.411084  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.412832  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.414883  4361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1736) took 1354 ms. Trace:
I20260709 12:14:03.415457  4361 rpcz_store.cc:276] 0709 12:14:02.060890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.061003 (+   113us) service_pool.cc:224] Handling call
0709 12:14:02.061315 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.061518 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.061543 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.092559 (+ 31016us) log.cc:844] Serialized 26 byte log entry
0709 12:14:02.419579 (+327020us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:02.419638 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.419744 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.393111 (+973367us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:03.414521 (+ 21410us) raft_consensus.cc:1685] finished
0709 12:14:03.414549 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.414810 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43026176,"thread_start_us":279321,"threads_started":1,"wal-append.queue_time_us":359326}
I20260709 12:14:03.422297  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.425155  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.426968  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.430140  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.431205  4357 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:03.432533  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.448642  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.441444  6769 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.449751  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:03.442600  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.398785  6588 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.452240  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.447283  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.449009  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.453871  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.455777  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.456663  4996 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.458150  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.458940  4438 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:14:03.461704  6404 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.463975  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.466939  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.455099  4512 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:03.472121  4364 raft_consensus.cc:2368] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5.
I20260709 12:14:03.474182  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.478286  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.475548  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.484304  4365 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:03.399487  6739 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.493909  5030 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:03.469144  6779 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.481700  4331 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.498896  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.497265  6558 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.509333  6558 raft_consensus.cc:493] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.509720  6558 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.513410  4515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47840 (request call id 1809) took 1477 ms. Trace:
I20260709 12:14:03.513803  4515 rpcz_store.cc:276] 0709 12:14:02.035543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.035730 (+   187us) service_pool.cc:224] Handling call
0709 12:14:02.035967 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.569088 (+533121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.569122 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:02.569162 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:02.569191 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.513192 (+944001us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54000cf654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:14:03.513236 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.513357 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213656960}
I20260709 12:14:03.514521  6669 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:03.471854  6770 consensus_queue.cc:1048] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:03.515110  6669 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.495484  4479 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.501777  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.475327  6777 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.546413  6669 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.496289  6414 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.499984  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.459483  6701 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.543995  6613 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.518322  4507 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:03.572072  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:14:03.526166  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 44613.4us
W20260709 12:14:03.552677  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 57308.2us
I20260709 12:14:03.503093  6778 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.496083  6738 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.575389  6738 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.571389  6779 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.580045  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.549569  6732 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.582187  6407 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.583488  4506 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:03.584803  6754 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.469s	user 0.002s	sys 0.000s
I20260709 12:14:03.587647  6769 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.597117  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.578887  6597 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.552892  6750 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.608441  4359 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:03.606454  6750 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.610770  6769 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.611361  6769 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.590088  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.613466  6769 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.602706  4362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1733) took 1561 ms. Trace:
I20260709 12:14:03.615588  4362 rpcz_store.cc:276] 0709 12:14:02.040950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.041062 (+   112us) service_pool.cc:224] Handling call
0709 12:14:02.043079 (+  2017us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:02.677703 (+634624us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b180043b8e0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0e5bfb 00007f124e0f064b
0709 12:14:02.677821 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.677844 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:02.678404 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:14:02.954637 (+276233us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:02.982192 (+ 27555us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.544540 (+562348us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180043b8e0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124b002a40 00007f124affd4e4 00007f124affd455 00007f1251ae53c7 00007f124e0f79a7 00007f124e1070bf 00007f124e107038
0709 12:14:03.544774 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.545003 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.545097 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.584177 (+ 39080us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:03.602406 (+ 18229us) raft_consensus.cc:1685] finished
0709 12:14:03.602438 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.602621 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":548577,"prepare.queue_time_us":599454,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":37,"raft.queue_time_us":79016,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":53438,"spinlock_wait_cycles":193174400,"thread_start_us":370071,"threads_started":2,"wal-append.queue_time_us":373197}
I20260709 12:14:03.594703  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.618580  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:03.611465  6750 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.570303  6613 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.599807  6407 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.623095  4996 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.625922  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.577911  6779 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:03.626835  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.630774  4365 raft_consensus.cc:2410] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:14:03.622562  4362 raft_consensus.cc:1240] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:03.627597  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.631628  5025 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:03.639396  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.623632  6613 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.596000  6414 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.622246  6780 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.602648  6676 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.651304  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:03.652020  5025 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.655352  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.644117  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.641741  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.660732  4481 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.661043  5025 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:03.661793  5027 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:03.662595  6778 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.663276  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:03.663569  6777 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.663913  5024 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.664136  6778 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:03.664574  6778 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.650107  6701 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.643399  6721 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:03.665354  6721 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.667052  4479 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.667918  6721 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.668609  6699 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.669296  6699 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:03.672955  6717 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.673704  6778 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.591686  6558 raft_consensus.cc:515] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.629402  6669 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.676029  6778 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.681178  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.689154  5030 raft_consensus.cc:2393] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.692754  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:03.692272  6714 consensus_queue.cc:1059] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:14:03.696230  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:03.696827  4440 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.697927  6558 leader_election.cc:290] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.677649  6414 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.686069  6676 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.701301  6676 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.703480  6676 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:03.706311  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.678488  6717 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.705626  5024 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:03.670432  6699 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.710312  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.713626  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:03.711833  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.716396  4359 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.719798  4440 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:03.721511  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:03.720584  4330 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:03.715555  6769 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.765080  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:03.765793  4506 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.765434  6769 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.768148  6414 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:03.714432  6782 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.720209  6613 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.760529  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.763339  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:03.779098  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.774065  4506 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:03.770654  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:14:03.777626  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 57125.6us
I20260709 12:14:03.783368  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.779166  6588 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.786477  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:03.787014  6769 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:03.773562  6704 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.795341  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.780742  6714 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.800226  6714 raft_consensus.cc:697] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:03.801100  6714 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.804615  4359 raft_consensus.cc:2468] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:03.805997  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:03.808087  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.808241  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.809191  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.787283  4509 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:03.811530  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.814077  4366 raft_consensus.cc:2368] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 5. Current term is 6.
I20260709 12:14:03.814594  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.815362  4358 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:03.826622  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.839395  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27395ba03b841e5969f26a9b223fe7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:03.840032  4360 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.840165  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.842967  4997 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.843912  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:03.843304  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.806807  6677 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.851696  4360 raft_consensus.cc:2468] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:03.849282  4406 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.718168  6779 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.825376  6769 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.813813  6643 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.835961  6588 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:03.825531  6623 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:03.835978  6704 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:03.861217  6677 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.850400  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:03.869575  6670 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.876715  4407 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.881072  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:03.880026  6722 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:03.855854  6644 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.857487  6759 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.885743  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:03.908264  4363 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:03.857235  6137 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:03.860729  6720 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:14:03.896546  6674 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.880728  6783 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:14:03.916899  6589 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.884719  6623 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.884949  6643 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:03.891691  6735 consensus_queue.cc:1059] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:03.938707  6704 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.897835  6769 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:03.909456  6670 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:04.010133  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 110908us
W20260709 12:14:04.011373  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 85405us
W20260709 12:14:04.013278  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 147688us
W20260709 12:14:04.014478  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 133476us
I20260709 12:14:04.005524  6613 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.016283  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.018100  4407 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.033893  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:04.035281  6589 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:04.036084  6759 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:04.036521  6759 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:04.037385  6759 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.042361  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.038407  6759 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.054373  4511 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:04.059986  6797 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:04.071197  6722 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.017076  6720 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:14:04.075381  6677 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.050439  6584 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.082325  6623 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.085047  4407 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.100342  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.137761  6670 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:04.141496  6795 log.cc:927] Time spent T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.277s	user 0.004s	sys 0.000s
I20260709 12:14:04.144795  4330 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.146108  6727 raft_consensus.cc:2749] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:04.150920  6806 log.cc:927] Time spent T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:14:04.156201  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 71507.9us
I20260709 12:14:04.160679  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:04.161288  4510 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.157189  6727 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:04.163822  6167 raft_consensus.cc:3055] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.164366  6167 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:04.163949  6727 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.165283  6167 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.166337  6727 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:04.166584  6167 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.167438  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.161123  4481 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.169584  4514 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:04.171463  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.179291  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:04.161634  6265 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.173488  6783 raft_consensus.cc:2804] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:04.186185  6783 raft_consensus.cc:697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:04.187144  6783 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:04.188239  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.190254  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.191629  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.159281  6749 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:04.204617  6137 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.205478  6137 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.208516  4407 leader_election.cc:400] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 5. Current term is 6.
I20260709 12:14:04.208835  4407 leader_election.cc:403] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:04.209371  6552 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.202309  6749 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.210894  6643 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:04.211483  6749 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:04.161545  6732 consensus_queue.cc:1059] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:04.212574  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.213020  6732 consensus_queue.cc:1243] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:04.213198  4507 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:04.168749  6769 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.217656  4406 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.218472  6137 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.220309  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:04.220770  6552 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 5. Current term is 6.
I20260709 12:14:04.223096  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.223253  6747 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:04.225620  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.227293  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.228856  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.230145  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:04.231457  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.233011  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:04.234659  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.236507  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.238343  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.254079  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.254896  4441 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:04.259091  4364 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:04.262068  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:04.213542  6732 raft_consensus.cc:3055] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.268880  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.270255  4441 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:04.275895  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.276746  4515 raft_consensus.cc:2368] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5.
I20260709 12:14:04.279731  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:14:04.281165  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.280912  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:04.281862  4360 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:04.282616  4997 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.284195  4997 leader_election.cc:304] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.288012  4441 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.291144  4510 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:04.273797  6778 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:14:04.268904  6732 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:04.301241  4509 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:04.303131  4515 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.311358  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:04.313890  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 45139.2us
I20260709 12:14:04.315593  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:04.317867  4996 leader_election.cc:400] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5.
I20260709 12:14:04.318408  4996 leader_election.cc:403] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:04.316874  6670 raft_consensus.cc:2749] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:04.322319  6669 raft_consensus.cc:2804] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:04.323050  6670 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5.
I20260709 12:14:04.325536  4997 leader_election.cc:400] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5.
I20260709 12:14:04.319496  4996 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.330394  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.331233  4435 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:04.320345  4441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:04.335199  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.338652  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.335476  4441 raft_consensus.cc:606] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.344173  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.318553  6588 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:04.343778  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:04.346549  4511 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.312744  6732 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.351905  6732 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.359932  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:04.340847  6669 raft_consensus.cc:697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:04.342970  6771 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.363756  6763 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.376098  6763 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.376554  6763 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.387712  4441 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:04.391562  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.395879  4434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:04.396840  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.397024  4434 raft_consensus.cc:606] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.413690  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.427600  6669 consensus_queue.cc:237] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.431603  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:04.432365  4432 raft_consensus.cc:606] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:04.432753  4432 raft_consensus.cc:614] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:04.437594  4434 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:04.450559  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.467454  4357 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.382055  6738 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.477059  4332 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.480907  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:04.487618  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 83337.1us
I20260709 12:14:04.488595  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:04.489293  4432 raft_consensus.cc:606] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
W20260709 12:14:04.489766  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45108.2us
I20260709 12:14:04.491278  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:04.493907  6643 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.494175  4332 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.495463  4332 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.495703  6738 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.496452  6738 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.496706  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.497697  6407 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.497915  4332 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.498812  6407 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.500286  4332 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.501118  6727 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:04.502300  4332 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.503245  6727 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.506500  4332 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:04.509500  6674 consensus_meta.cc:287] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:14:04.515311  6674 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.516242  6671 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.518718  6749 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:04.520619  6414 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.521526  4332 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:04.510402  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 69304.4us
I20260709 12:14:04.523471  6749 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.524984  4332 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.525786  6749 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:04.528842  4440 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:04.529847  4332 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.531558  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.532980  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.543620  4332 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:04.629822  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 86292.5us
W20260709 12:14:04.631852  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 74992.8us
W20260709 12:14:04.632876  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 89062.4us
I20260709 12:14:04.631027  4332 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:04.535053  6749 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:04.654317  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.555454  6732 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:04.666137  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:04.672134  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.641891  6769 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:04.676620  6777 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:04.662940  6727 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:04.672391  6738 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:04.672776  6557 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.687668  6137 raft_consensus.cc:993] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.696274  6749 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:04.711723  6722 consensus_queue.cc:1059] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.713299  6747 raft_consensus.cc:993] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.713809  6589 raft_consensus.cc:1081] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.711038  4407 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.680562  6777 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:04.720578  5024 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:04.725925  6677 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.711752  6749 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.734409  6721 raft_consensus.cc:993] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.692313  6727 raft_consensus.cc:697] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:04.740586  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.750701  4332 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.753916  5030 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:04.744745  6167 consensus_meta.cc:287] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.004s
I20260709 12:14:04.748627  6265 raft_consensus.cc:1081] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.744999  6137 raft_consensus.cc:1081] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:04.753012  6769 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:04.756568  6404 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:04.759531  6671 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:14:04.773648  6749 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:04.742079  6763 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:04.775177  6727 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.779464  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:04.788404  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.796473  4332 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:04.799999  6749 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.758674  6777 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.852757  6747 raft_consensus.cc:3055] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.853271  6747 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:04.854158  6747 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.834383  6714 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:04.856886  6714 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:04.864158  6763 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:04.876214  6777 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:04.920485  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.932801  6528 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.933423  6528 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:04.940043  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.940948  4514 raft_consensus.cc:2410] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for term 6 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:14:04.952629  4364 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:04.959939  4331 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:04.964900  6404 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:04.965266  6407 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.967545  6747 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.985080  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:04.989526  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:04.989883  4433 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:04.990137  4434 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.994201  4359 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:04.995121  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:04.995921  4361 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.997398  4263 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 144) took 7203 ms. Trace:
I20260709 12:14:05.002489  6404 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:05.003104  6404 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.007329  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:05.008853  6404 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:05.010031  4359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:05.010712  4359 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.011220  4359 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.957742  6528 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.015791  4363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:05.016397  4363 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.016812  4363 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.018970  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:04.997798  4263 rpcz_store.cc:276] 0709 12:13:57.793795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.794084 (+   289us) service_pool.cc:224] Handling call
0709 12:13:57.933082 (+138998us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400399c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e057090 00007f124e0f5f3a 00007f1253eabe9c 00007f1253faa04e 00007f125246b2a4 00007f125246b232 00007f125246b161 00007f125246b0dc 00007f125246a392 00007f124c42848c 00007f124c4278c6
0709 12:14:04.997332 (+7064250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.087853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.357341 (+269488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.359935 (+  2594us) write_op.cc:435] Acquired schema lock
0709 12:14:02.412992 (+ 53057us) tablet.cc:662] Decoding operations
0709 12:14:02.697203 (+284211us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.697265 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.697291 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:14:02.698391 (+  1100us) tablet.cc:701] Row locks acquired
0709 12:14:02.698405 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:02.698566 (+   161us) write_op.cc:270] Start()
0709 12:14:02.698669 (+   103us) write_op.cc:276] Timestamp: P: 1783599242698518 usec, L: 0
0709 12:14:02.698693 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.699510 (+   817us) log.cc:844] Serialized 5218 byte log entry
0709 12:14:03.465975 (+766465us) op_driver.cc:464] REPLICATION: finished
0709 12:14:03.574426 (+108451us) write_op.cc:301] APPLY: starting
0709 12:14:03.574517 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:03.574781 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.574890 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.576353 (+  1463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.576612 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:14:03.576662 (+    50us) write_op.cc:312] APPLY: finished
0709 12:14:03.576967 (+   305us) log.cc:844] Serialized 95 byte log entry
0709 12:14:03.577167 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.577500 (+   333us) write_op.cc:454] Released schema lock
0709 12:14:03.577551 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:03.624874 (+ 47323us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.630954 (+  6080us) write_op.cc:454] Released schema lock
0709 12:14:03.855322 (+224368us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5400399c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ea32a 00007f124e06ff14 00007f124e06fec3 00007f124e06fe38 00007f124e06fdf3 00007f124e06f0dc 00007f124e098e16 00007f124e080cbb 00007f124e06b39d 00007f124e06ed75
Metrics: {"mutex_wait_us":37920,"reported_tablets":18,"spinlock_wait_cycles":245056256,"child_traces":[["op",{"apply.queue_time_us":101291,"apply.run_cpu_time_us":3477,"apply.run_wall_time_us":21326,"num_ops":13,"prepare.queue_time_us":103343,"prepare.run_cpu_time_us":22851,"prepare.run_wall_time_us":874900,"raft.queue_time_us":139239,"raft.run_cpu_time_us":15522,"raft.run_wall_time_us":477149,"replication_time_us":752246,"spinlock_wait_cycles":52024064,"thread_start_us":446621,"threads_started":4,"wal-append.queue_time_us":299672,"wal-append.run_cpu_time_us":21623,"wal-append.run_wall_time_us":1630868}]]}
I20260709 12:14:05.031867  6776 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:05.033164  4365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:05.033972  4365 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.034435  4365 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.010525  6404 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.042580  4364 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:05.035578  4434 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:05.035989  4359 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.047920  6670 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:05.057776  6801 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:05.061448  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:05.074401  4358 raft_consensus.cc:1240] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.075706  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:05.076298  4438 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:05.076704  4438 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:05.078276  4361 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:05.077836  4438 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.079274  4438 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.081612  4359 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.030267  4363 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.080924  4365 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.079774  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:05.092432  4365 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.096338  4363 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:05.097412  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:05.098017  5030 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.101991  4440 raft_consensus.cc:3055] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:05.102428  4440 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:05.102209  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:05.103170  4436 raft_consensus.cc:3055] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:05.106510  4359 raft_consensus.cc:1240] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:05.103585  4436 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:05.108932  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:05.109553  4439 raft_consensus.cc:3055] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:05.109881  4439 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:05.066336  6648 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:05.110960  4438 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:05.113359  4509 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:05.064335  6404 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.121222  6714 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.122105  4365 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:05.126523  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:05.123261  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:05.128592  4509 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.109354  4436 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.128451  4332 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:05.131955  5030 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:05.095832  6804 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:05.135130  4436 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.134613  4364 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.137702  4330 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:05.128549  4439 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.112913  6727 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:05.148604  6770 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:14:05.165354  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.130872  6414 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:14:05.143996  6648 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:05.194789  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:05.195436  4508 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.195775  6676 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:05.196318  6676 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.198484  6676 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.192970  4262 catalog_manager.cc:5697] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.133490  6812 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:05.143280  6825 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:05.206041  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.172065  4440 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.160944  6727 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.169024  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:05.159240  6804 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:05.200201  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:05.234535  4511 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.190894  6414 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.202342  4262 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 3 to 4, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.239554  4262 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.209620  6601 consensus_queue.cc:1059] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.215047  4407 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:05.221395  4439 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.154217  4509 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
W20260709 12:14:05.223570  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 95243.2us
I20260709 12:14:05.122939  6404 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:05.243186  4366 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.242004  4262 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 3, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.247644  4363 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:05.249548  4360 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:05.206543  6648 raft_consensus.cc:697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:05.260095  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.260991  4510 raft_consensus.cc:2468] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:05.261104  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.263790  6648 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.235805  6825 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:14:05.266624  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 124152us
I20260709 12:14:05.271178  4262 catalog_manager.cc:5697] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 5, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.273106  4262 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.230952  6812 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.275558  4262 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.283633  5030 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.284085  4262 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.291409  4262 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.293596  4262 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.295773  4262 catalog_manager.cc:5697] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.249289  6414 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.303076  4436 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
I20260709 12:14:05.303812  4508 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:05.310238  4262 catalog_manager.cc:5697] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.312500  4262 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 5, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.313746  4262 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.315636  4262 catalog_manager.cc:5697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.316855  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:05.316052  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:05.317466  4262 catalog_manager.cc:5697] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.319410  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:05.319536  4262 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.321307  4262 catalog_manager.cc:5697] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.324559  4262 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.326385  4262 catalog_manager.cc:5697] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 3 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:05.329656  4511 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 2.
W20260709 12:14:05.321272  6828 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.238s	user 0.001s	sys 0.003s
I20260709 12:14:05.335332  4331 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:14:05.343505  6832 log.cc:927] Time spent T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:14:05.344996  6700 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:05.345458  6584 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:05.345834  4439 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:05.351897  4510 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.353535  6769 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:05.359941  4441 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:05.335323  6777 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:05.356397  6643 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:05.386193  6643 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:05.323578  6804 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.369277  6769 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:05.367427  5024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:39134
I20260709 12:14:05.403460  6643 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.393184  6528 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:05.421828  4511 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:05.357256  6825 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:05.422911  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.399901  6777 consensus_queue.cc:1243] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:14:05.446416  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 129150us
I20260709 12:14:05.416755  5024 raft_consensus.cc:606] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:05.423780  6727 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.457082  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:05.459296  4366 raft_consensus.cc:2393] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 7: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:05.450522  6782 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:05.465817  6812 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:05.459492  6727 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:14:05.537072  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:05.539450  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:05.540597  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:05.553732  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:05.555658  4439 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:14:05.542304  6727 consensus_queue.cc:1243] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer a359ff757b3a4babb1229aa08bc44a60 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:05.541890  6414 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:05.563306  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.564672  4509 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
W20260709 12:14:05.597780  6841 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:14:05.601583  6840 log.cc:927] Time spent T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:14:05.603173  6769 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:05.608002  6839 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:14:05.693195  4440 raft_consensus.cc:3060] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.696003  4406 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:05.700099  6853 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:05.701054  6853 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:05.701411  6853 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.714176  4440 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:05.720980  4509 raft_consensus.cc:1240] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:05.732901  6835 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.209s	user 0.009s	sys 0.008s
W20260709 12:14:05.744007  6833 log.cc:927] Time spent T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:14:05.766577  5030 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:05.768352  6717 consensus_queue.cc:1059] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:05.769197  6717 consensus_queue.cc:1243] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer 133eea4ce99644f5adbd12c985fc95cb log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:05.775326  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:05.779733  4509 pending_rounds.cc:85] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 1
I20260709 12:14:05.780742  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:05.781495  4363 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:05.786193  4509 pending_rounds.cc:107] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:14:05.787479  4509 raft_consensus.cc:2889] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:05.886468  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 63174.6us
I20260709 12:14:05.915259  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:05.916898  6717 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:05.920150  6801 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:05.920723  6801 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.921187  6801 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:05.964373  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 403951us
I20260709 12:14:05.973644  4363 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:06.025051  4432 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:06.029978  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 114787us
I20260709 12:14:06.097795  6643 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.098631  6643 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.168289  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:06.173668  6584 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.174326  6584 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.176496  6584 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:06.202317  4332 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:06.232898  4332 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:06.210224  4330 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:06.246563  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:06.247679  4508 raft_consensus.cc:2410] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:14:06.248526  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 57488.6us
I20260709 12:14:06.216475  6814 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:06.202365  6853 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.256708  4432 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:06.257719  6853 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.259268  6780 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:06.260828  6714 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:06.267766  5030 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:06.268384  4332 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:06.245765  6727 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:06.277947  6854 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.578s	user 0.005s	sys 0.031s
I20260709 12:14:06.280335  4509 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:06.269088  6814 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.246519  6643 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:06.294129  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 65481.4us
I20260709 12:14:06.301389  4332 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:06.305647  6867 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:06.308228  6714 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:06.269277  6584 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:06.316213  4514 raft_consensus.cc:3055] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.316753  4514 raft_consensus.cc:740] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:06.309830  6404 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:06.453169  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 198786us
I20260709 12:14:06.310070  6727 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.474867  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:06.544708  4366 raft_consensus.cc:2393] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 7: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:06.313259  6601 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:06.309404  6801 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.312755  6559 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:06.434491  6584 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.580619  6714 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:14:06.692720  6727 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:06.683563  6601 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.759433  6414 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:06.760128  6414 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.762427  6414 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:06.763556  6814 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:06.764146  6864 log.cc:927] Time spent T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.471s	user 0.001s	sys 0.000s
I20260709 12:14:06.693995  6559 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.771601  6674 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:06.757858  6727 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.790096  6801 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:06.790522  6844 log.cc:927] Time spent T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 1.248s	user 0.000s	sys 0.035s
W20260709 12:14:06.797803  6850 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.913s	user 0.005s	sys 0.002s
W20260709 12:14:06.798393  6870 log.cc:927] Time spent T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:14:06.828158  4330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.066s	sys 0.121s
W20260709 12:14:06.829113  4330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.066s	sys 0.121s
W20260709 12:14:06.829610  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 559919us
W20260709 12:14:06.832319  4332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.116s	sys 0.196s
W20260709 12:14:06.832958  4332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.118s	sys 0.196s
W20260709 12:14:06.833408  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 530532us
I20260709 12:14:06.835229  6559 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:06.836316  6559 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:06.837589  6559 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.840135  4510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57688 (request call id 289) took 1537 ms. Trace:
I20260709 12:14:06.841439  6559 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:06.844272  6851 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:06.844738  6601 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.845556  6601 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.845194  6851 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.848063  6584 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:06.848275  6851 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:06.846412  6601 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.840713  4510 rpcz_store.cc:276] 0709 12:14:05.302908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.304060 (+  1152us) service_pool.cc:224] Handling call
0709 12:14:05.326460 (+ 22400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:05.351683 (+ 25223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:05.471647 (+119964us) log.cc:844] Serialized 14 byte log entry
0709 12:14:05.755812 (+284165us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:05.760099 (+  4287us) log.cc:844] Serialized 52 byte log entry
0709 12:14:05.760278 (+   179us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:05.760318 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.760411 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:06.797132 (+1036721us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:06.839199 (+ 42067us) raft_consensus.cc:1685] finished
0709 12:14:06.839412 (+   213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:06.839799 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7693,"raft.queue_time_us":51966,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":1943,"spinlock_wait_cycles":4186880,"thread_start_us":170601,"threads_started":1,"wal-append.queue_time_us":364960}
I20260709 12:14:06.856693  6601 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.857424  6727 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:06.860442  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 389962us
W20260709 12:14:06.865145  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 384151us
I20260709 12:14:06.867487  6859 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.868585  6859 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.874434  6866 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:06.888445  6878 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:06.889104  6825 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:06.889794  6878 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.890066  6825 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.893127  6878 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.893222  4514 consensus_queue.cc:260] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.896971  6825 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.783784  6674 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.909121  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:06.910162  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:06.911429  6882 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:06.915623  4514 raft_consensus.cc:3060] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.917043  6669 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:06.918715  4361 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:06.920758  6859 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:06.926599  6601 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.927977  6601 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:06.930832  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:06.930851  6601 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.935236  6669 raft_consensus.cc:993] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:06.935460  6878 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:06.939179  6674 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:06.936441  6878 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.947181  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:06.951150  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:06.951484  4366 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:06.912638  6882 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.950453  6878 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:06.976351  4362 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:06.980800  6887 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:06.981665  6887 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:06.936436  6890 raft_consensus.cc:1081] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:06.991787  4514 raft_consensus.cc:1275] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:06.992722  4514 pending_rounds.cc:85] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Aborting all ops after (but not including) 6
I20260709 12:14:06.993117  4514 pending_rounds.cc:107] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:06.993538  4514 raft_consensus.cc:2889] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:06.994969  6700 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:14:06.995376  6677 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:06.996186  6677 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.015267  4514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57688 (request call id 291) took 1635 ms. Trace:
I20260709 12:14:07.016774  6887 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.017627  6601 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.018748  6601 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.019771  6842 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.021364  6714 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.021667  6842 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.022039  6714 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.022713  6265 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.023254  6721 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.023437  6265 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.024009  6721 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.026024  6265 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.026134  6842 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.029167  6601 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.015777  4514 rpcz_store.cc:276] 0709 12:14:05.379745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.380606 (+   861us) service_pool.cc:224] Handling call
0709 12:14:05.380889 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.316071 (+935182us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b54002a6820. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0ef1c0 00007f124e0f0231 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c
0709 12:14:06.892164 (+576093us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54002a6820. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e06b06f 00007f124e0e3f60 00007f124e0e57de 00007f124e0efb49 00007f124e0f0416 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62
0709 12:14:06.994501 (+102337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.015189 (+ 20688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356473984}
I20260709 12:14:07.029696  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.026230  6721 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.033075  6714 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.033188  6778 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.033974  6778 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.045199  4515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:07.046238  4515 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:07.046765  4515 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.048023  6887 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.048823  6887 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.050216  6770 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:07.051694  6803 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.052631  6803 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.057273  6887 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.059355  6778 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.065773  6559 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:06.998781  6677 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.071638  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.065775  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:07.073033  4508 raft_consensus.cc:2368] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:07.074486  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.081029  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.081857  4434 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:07.082998  6584 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.083284  6803 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.083722  6584 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.066673  6559 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.090612  6559 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.095754  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a003a2ac88974139bde682ffd3dea64c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.097839  6877 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.098556  6877 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.081053  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.102202  6877 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.117020  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.115528  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.122350  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.124485  6882 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.125654  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.126484  4513 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:07.112572  6677 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.121376  6559 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.136792  6677 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.137382  6559 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.138212  4439 raft_consensus.cc:2410] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:07.139847  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.140027  6559 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.142501  6584 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.142879  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.143224  4439 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:07.143348  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.144101  4508 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:07.147857  4515 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.155378  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.157436  6559 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.158174  6851 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.159361  6851 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.161917  6851 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.164038  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.166042  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:07.170747  6614 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.171196  6614 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:07.171572  6614 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.171845  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.136792  6734 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.173190  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.172955  6734 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.174513  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.175622  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.176898  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.177130  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.182090  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.182657  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.185185  4515 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.189699  5030 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:07.164482  6559 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.195611  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.195822  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.196125  6734 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.196326  4433 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:07.196609  4439 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:07.167218  6882 consensus_queue.cc:1048] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:07.197779  6677 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.200637  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.202939  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.204262  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.229358  4997 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:07.231274  6890 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:07.231348  6777 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.232367  6777 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.236548  6763 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:07.238526  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.239157  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.239499  4358 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:07.214809  4261 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193), VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194), VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195), VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:07.242452  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.243105  4435 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:07.251538  6559 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.254484  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.255244  4360 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
I20260709 12:14:07.255746  4441 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:07.258929  4997 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:07.267369  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.267925  6882 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.268391  6882 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.268625  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.268762  6882 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:07.269272  4478 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.268953  5022 raft_consensus.cc:1240] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:07.286743  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:07.293380  5024 raft_consensus.cc:3055] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:07.293819  5024 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:07.291286  6614 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.294862  5024 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.296468  5024 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:07.296708  6614 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.291257  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.293572  6834 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:14:07.309379  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:07.312726  4434 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:07.315456  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:07.315910  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.320581  4330 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:07.323427  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:07.324577  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.326335  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:07.329041  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.330852  6614 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:07.366382  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 45906.3us
I20260709 12:14:07.368099  6714 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:07.369086  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.370433  6769 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.370896  6769 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.371307  6769 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.375002  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.384275  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.382974  6778 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:07.386564  6778 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.389092  6778 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.395555  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.396368  4433 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
W20260709 12:14:07.399245  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 75950.6us
I20260709 12:14:07.400388  4332 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:07.403301  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.407640  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.406211  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:07.409765  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:07.419394  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 46499.4us
W20260709 12:14:07.421445  4481 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.423424  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:07.403401  6714 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:07.452876  6676 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.455098  6404 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:07.455595  6404 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.456038  6404 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.456086  6778 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:07.456933  6778 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:07.459854  6900 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:07.465878  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.466564  4357 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:07.467322  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.473002  6778 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.473820  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:07.474450  4433 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.474503  4407 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:07.477177  6706 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.436834  6877 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.477180  4262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45316 (request call id 233) took 5504 ms. Trace:
W20260709 12:14:07.496732  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 49050.3us
I20260709 12:14:07.500746  6777 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:07.504462  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:07.505216  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.505554  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.506305  4360 raft_consensus.cc:2393] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:07.506361  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.507122  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.507504  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.508212  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.505213  4357 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.508704  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.510084  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.510835  4363 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:14:07.498600  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.515224  4437 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:07.519541  5024 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:14:07.440797  4511 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:07.535468  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 52837.4us
I20260709 12:14:07.539007  4433 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:07.540702  4357 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:07.539187  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:07.556548  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.552763  4407 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
W20260709 12:14:07.564971  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 109476us
I20260709 12:14:07.520738  6825 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:07.582305  5030 raft_consensus.cc:1240] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.554629  6877 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:14:07.596577  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 43866.9us
I20260709 12:14:07.567142  6803 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:07.635646  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.644241  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:07.645397  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 43971.7us
I20260709 12:14:07.651264  4479 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:14:07.654053  6908 log.cc:927] Time spent T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:14:07.650080  6877 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.655403  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:07.657380  6904 log.cc:927] Time spent T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
I20260709 12:14:07.658324  6722 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.659339  6877 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.483031  4262 rpcz_store.cc:276] 0709 12:14:01.994973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.006207 (+ 11234us) service_pool.cc:224] Handling call
0709 12:14:07.476952 (+5470745us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:05.604193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:05.605043 (+   850us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:05.605099 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:14:05.605131 (+    32us) tablet.cc:662] Decoding operations
0709 12:14:05.733249 (+128118us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:05.733366 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:05.733405 (+    39us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:14:05.746508 (+ 13103us) tablet.cc:701] Row locks acquired
0709 12:14:05.746527 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:14:05.746710 (+   183us) write_op.cc:270] Start()
0709 12:14:05.746849 (+   139us) write_op.cc:276] Timestamp: P: 1783599245746648 usec, L: 0
0709 12:14:05.746867 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:14:05.747684 (+   817us) log.cc:844] Serialized 7892 byte log entry
0709 12:14:06.279654 (+531970us) op_driver.cc:464] REPLICATION: finished
0709 12:14:06.315686 (+ 36032us) write_op.cc:301] APPLY: starting
0709 12:14:06.315802 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:06.316387 (+   585us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:06.316551 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:06.318861 (+  2310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:06.684865 (+366004us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:14:06.695696 (+ 10831us) write_op.cc:312] APPLY: finished
0709 12:14:06.772035 (+ 76339us) log.cc:844] Serialized 139 byte log entry
0709 12:14:06.778281 (+  6246us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:06.783204 (+  4923us) write_op.cc:454] Released schema lock
0709 12:14:06.785206 (+  2002us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:06.791048 (+  5842us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:06.791089 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":35702,"apply.run_cpu_time_us":6312,"apply.run_wall_time_us":475295,"num_ops":20,"prepare.queue_time_us":228017,"prepare.run_cpu_time_us":59857,"prepare.run_wall_time_us":279657,"raft.queue_time_us":291851,"raft.run_cpu_time_us":3447,"raft.run_wall_time_us":168920,"replication_time_us":532617,"thread_start_us":387842,"threads_started":4,"wal-append.queue_time_us":160645}]]}
W20260709 12:14:07.676412  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 68526.4us
I20260709 12:14:07.635031  6825 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.671828  6722 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.698402  6749 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:07.698843  4391 heartbeater.cc:646] Failed to heartbeat to 127.3.34.254:42447 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.34.254:42447 timed out after 15.000s (SENT)
I20260709 12:14:07.702288  6769 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.688565  6722 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.672771  6803 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.740681  4365 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:07.751518  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 115352us
I20260709 12:14:07.732892  6584 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:07.760762  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.726516  6882 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.789173  4407 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:07.762281  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:07.796801  4436 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:07.827287  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 176094us
W20260709 12:14:07.843830  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 87101.4us
I20260709 12:14:07.849704  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.851477  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.867035  5025 raft_consensus.cc:1240] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.867758  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.885244  6882 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:07.845216  6584 raft_consensus.cc:697] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:07.887305  6584 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:07.892055  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.893625  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.896661  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.897490  4510 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:07.898763  6749 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:07.899369  6749 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.899463  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:07.900321  4514 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 2.
I20260709 12:14:07.906535  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.909130  6825 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.911597  6782 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.912566  6907 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.246s	user 0.000s	sys 0.011s
I20260709 12:14:07.915872  6769 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.916455  6803 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:07.912233  6782 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.920344  6916 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:07.921008  6916 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:07.922708  6727 consensus_queue.cc:1059] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:07.923862  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:07.924678  6727 raft_consensus.cc:3055] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.925104  6727 raft_consensus.cc:740] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:07.827344  6706 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:07.854542  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:07.950098  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:07.915868  6910 log.cc:927] Time spent T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.263s	user 0.004s	sys 0.001s
I20260709 12:14:07.955751  6706 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.002605  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:08.006487  4436 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:14:07.957142  6916 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.009770  6706 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:08.026327  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 282824us
I20260709 12:14:08.011888  6916 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:14:08.029935  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 185333us
I20260709 12:14:08.035432  6925 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:08.036424  6925 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:08.048380  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 189817us
I20260709 12:14:08.044834  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.051291  4362 raft_consensus.cc:2393] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:08.065034  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.040616  6925 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:08.074139  6909 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.356s	user 0.000s	sys 0.006s
I20260709 12:14:08.068517  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.079754  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.084854  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:08.087119  4406 leader_election.cc:400] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:08.087546  4406 leader_election.cc:403] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:08.088573  4506 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:08.052382  6916 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.090047  6874 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.092141  6916 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.099845  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.111205  4407 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
W20260709 12:14:08.113034  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 153109us
I20260709 12:14:08.113881  6559 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:08.114845  4406 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.116195  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.117383  4406 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:08.093200  6404 consensus_meta.cc:287] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.003s
I20260709 12:14:08.032131  6727 consensus_queue.cc:260] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.095731  6825 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:14:08.134541  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 90786us
I20260709 12:14:08.140202  4514 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:08.142716  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.144847  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.145624  6137 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.129244  6404 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.146363  6137 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.147514  6825 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.148329  6404 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:08.152793  6905 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.460s	user 0.008s	sys 0.009s
I20260709 12:14:08.146802  4406 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.117450  6722 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.139688  6782 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.156800  6677 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:08.163504  6137 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:08.174976  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 63925.9us
I20260709 12:14:08.176961  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.179441  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.180526  4406 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.168293  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:08.187633  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:08.185025  4406 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.188966  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:08.199450  6552 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.201768  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.175179  6677 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:08.210367  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.200789  6584 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.216853  6584 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.217159  6137 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.217705  5940 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.190830  6714 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.220551  4406 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.225678  6928 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.226325  6932 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.226832  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.229907  6706 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.231786  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.220402  6924 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.217283  6584 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.209453  6677 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.257468  6722 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.266016  6825 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:08.267112  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.267810  4363 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.203692  6749 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.280467  6749 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.236402  4406 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.239267  4481 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.237267  6803 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:08.249481  6903 log.cc:927] Time spent T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
W20260709 12:14:08.292068  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55724.6us
I20260709 12:14:08.292881  4406 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.293941  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:08.294632  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:08.296010  6803 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:08.297070  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59361.5us
I20260709 12:14:08.297840  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:08.299168  6928 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.299805  6928 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:08.300160  6928 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:08.300511  6928 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.300673  6706 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.301990  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.305336  4330 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:08.308159  6769 raft_consensus.cc:2749] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.308162  4331 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.311456  6918 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.312217  4481 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:08.313059  6782 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:08.313609  6782 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:08.314468  6782 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.316934  6727 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.312273  4331 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.319219  6749 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.312242  6918 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:14:08.321312  6921 consensus_queue.cc:1059] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:08.322400  6926 raft_consensus.cc:3055] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.322744  6926 raft_consensus.cc:740] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:08.323688  6926 consensus_queue.cc:260] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.312934  6877 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:14:08.326681  6926 raft_consensus.cc:3060] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.336532  6584 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.344856  4331 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.345968  6749 raft_consensus.cc:2749] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.347675  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.349124  4331 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.350162  6749 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.350419  6677 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.357724  4436 raft_consensus.cc:1240] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:08.365833  4363 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
W20260709 12:14:08.367282  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 71618.5us
I20260709 12:14:08.369041  4407 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:08.369653  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.370292  4363 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.376922  6877 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:08.377600  6877 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:08.381850  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 89066.5us
I20260709 12:14:08.382788  4406 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.384025  4358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.387750  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.388760  4361 raft_consensus.cc:1240] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.389832  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.392122  4406 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.395927  6937 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:08.391474  6769 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:08.401310  6584 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.401779  6769 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.402323  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.404259  6714 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.379887  6749 consensus_queue.cc:1059] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:14:08.406443  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.406795  6749 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:08.407230  6749 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:08.396320  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.406644  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.399058  6934 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.386264  6924 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:08.399772  4406 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.412319  6803 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.400460  6706 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.401065  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.391507  6825 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:08.414753  6825 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.401136  6937 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:08.417480  6937 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.418269  6918 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:08.418936  6918 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.412357  4406 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.421546  6932 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:08.421924  6932 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:08.422299  6932 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.425400  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.425856  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.430241  4481 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.430831  6677 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.432538  6912 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:08.433000  6918 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.433207  6912 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.435782  6877 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.436816  6912 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.441174  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.430868  6749 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.443547  6749 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.439308  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.445798  4515 raft_consensus.cc:2393] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 7: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:08.446712  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.439868  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.437397  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.449524  4513 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.440213  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.443626  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42d741e25d64c56a067245eb7cb14c2" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.444291  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.441677  6769 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.438555  6825 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.460116  4331 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.460449  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.461041  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:08.461584  4331 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.463522  4332 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.465380  4509 raft_consensus.cc:2468] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:08.466715  4481 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:08.468910  6778 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.469785  4513 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:08.470851  6929 raft_consensus.cc:2764] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:08.469192  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.474596  6929 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.476392  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.505760  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.506742  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.509768  6932 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.511173  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.512197  4481 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:14:08.519308  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 57789.1us
I20260709 12:14:08.521180  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.523058  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:14:08.525556  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 62160us
I20260709 12:14:08.525815  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.529289  6921 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.510589  6928 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.534281  4363 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:08.537040  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.524421  6929 raft_consensus.cc:2749] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:08.532420  6727 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.548262  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.527480  6778 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.554409  6921 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.557278  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.528373  6825 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.530213  6769 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:08.558650  4331 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.576340  4506 raft_consensus.cc:1240] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:08.559037  6912 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.583374  6727 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.596274  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:08.596679  6928 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:08.599304  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:08.602351  4406 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.603170  6937 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.608407  4407 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.611604  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.614055  4363 raft_consensus.cc:2393] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 7: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:14:08.611438  6137 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:08.619745  6137 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:08.620740  6926 consensus_queue.cc:1059] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.621773  6926 raft_consensus.cc:3055] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:08.622012  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.623546  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.624022  6921 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.624724  6921 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.625028  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.626760  6925 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.626616  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.627763  6925 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.628445  4996 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.622099  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:08.622093  6926 raft_consensus.cc:740] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:08.633811  6926 consensus_queue.cc:260] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.635279  6926 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.620743  6137 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.642505  6770 raft_consensus.cc:2804] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:08.643067  6770 raft_consensus.cc:697] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:08.643935  6770 consensus_queue.cc:237] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.644295  6614 consensus_queue.cc:1059] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:08.646821  6614 raft_consensus.cc:3055] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:08.648144  6614 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:08.609087  6932 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:08.667963  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:08.669301  4481 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.679481  4360 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
I20260709 12:14:08.685655  5025 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:08.701766  4481 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.708698  4407 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:08.709556  5940 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:08.710219  5940 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:08.706653  6928 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.712486  5940 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.723307  6614 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.724303  4360 raft_consensus.cc:1240] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.724824  6614 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:08.726082  6778 consensus_queue.cc:1059] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.727182  6778 raft_consensus.cc:3055] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.727517  6778 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:08.709056  6925 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.707314  6929 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:08.728379  6778 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.737998  6778 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.741379  4435 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:08.771423  6925 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:08.772245  6925 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.777478  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.779704  4360 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:08.780248  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.782292  6928 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:08.782697  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:08.783618  6926 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:08.774668  6925 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.794859  4436 raft_consensus.cc:1240] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:08.746577  6921 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:14:08.799719  6727 consensus_queue.cc:1059] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:08.800833  6727 raft_consensus.cc:3055] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:08.801196  6727 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:08.806582  6727 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:08.822939  4437 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.823767  6727 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:08.829607  4261 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45302 (request call id 275) took 16444 ms (client timeout 15000 ms). Trace:
W20260709 12:14:08.830230  4261 rpcz_store.cc:269] 0709 12:13:52.385561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.385834 (+   273us) service_pool.cc:224] Handling call
0709 12:14:08.829501 (+16443667us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:08.095155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:08.143055 (+ 47900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:08.143118 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:14:08.143139 (+    21us) tablet.cc:662] Decoding operations
0709 12:14:08.143576 (+   437us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:08.143675 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:08.143709 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:08.144037 (+   328us) tablet.cc:701] Row locks acquired
0709 12:14:08.144101 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:14:08.144291 (+   190us) write_op.cc:270] Start()
0709 12:14:08.144447 (+   156us) write_op.cc:276] Timestamp: P: 1783599248144219 usec, L: 0
0709 12:14:08.144468 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:08.145275 (+   807us) log.cc:844] Serialized 842 byte log entry
0709 12:14:08.539211 (+393936us) op_driver.cc:464] REPLICATION: finished
0709 12:14:08.585978 (+ 46767us) write_op.cc:301] APPLY: starting
0709 12:14:08.591867 (+  5889us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:08.592215 (+   348us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:08.597327 (+  5112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:08.706337 (+109010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:08.707995 (+  1658us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:08.709514 (+  1519us) write_op.cc:312] APPLY: finished
0709 12:14:08.727377 (+ 17863us) log.cc:844] Serialized 23 byte log entry
0709 12:14:08.727586 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:08.727675 (+    89us) write_op.cc:454] Released schema lock
0709 12:14:08.727732 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:08.728147 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:08.728175 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3421715,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":45650,"apply.run_cpu_time_us":3697,"apply.run_wall_time_us":142926,"num_ops":1,"prepare.queue_time_us":388046,"prepare.run_cpu_time_us":30765,"prepare.run_wall_time_us":140503,"raft.queue_time_us":153997,"raft.run_cpu_time_us":17253,"raft.run_wall_time_us":60996,"replication_time_us":389266,"thread_start_us":444651,"threads_started":4,"wal-append.queue_time_us":219077}]]}
I20260709 12:14:08.879884  6868 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.880481  6868 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.882675  6868 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:08.884445  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:08.886334  4360 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:08.887678  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:08.897536  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:08.900504  4433 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:08.901485  4511 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:08.903342  6614 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.903842  6614 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.904213  6614 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.913712  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:08.913712  6925 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:14:08.916939  4260 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 5 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:08.918433  6940 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:08.922892  4260 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:08.946025  6614 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:08.966485  4360 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:08.975417  5025 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:08.976734  6137 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:08.977792  6722 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:08.986497  4358 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:08.926057  4260 catalog_manager.cc:5697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.028582  4260 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.026459  6940 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:14:09.056964  4260 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.062734  4363 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:09.066107  6770 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:09.079015  4260 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.083297  4260 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 5 to 7, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.101646  6614 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:09.113602  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:09.114511  4357 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.122824  4260 catalog_manager.cc:5697] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 1 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:09.136998  4360 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:09.137351  4357 raft_consensus.cc:2468] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:09.145176  4511 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:09.147081  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:09.147459  4997 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:09.150950  4360 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:09.155838  4260 catalog_manager.cc:5697] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.161257  4433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:09.162017  4433 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.164325  5940 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:09.167433  4511 raft_consensus.cc:1275] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:09.162467  5025 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.167881  4433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:09.168533  4433 raft_consensus.cc:606] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.168990  6763 consensus_queue.cc:1048] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:09.159184  6614 raft_consensus.cc:2804] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:09.187656  4510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:09.182400  4361 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.188282  4510 raft_consensus.cc:606] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.188752  4510 raft_consensus.cc:614] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:09.191643  4433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:09.158669  6722 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:14:09.180773  6614 raft_consensus.cc:697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:09.193909  4260 catalog_manager.cc:5697] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.192278  4433 raft_consensus.cc:606] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.199393  6137 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:09.207252  4436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:09.207878  4436 raft_consensus.cc:606] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.209836  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:09.211582  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:09.212571  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:09.221199  4260 catalog_manager.cc:5697] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.275221  4506 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.306744  4506 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:09.308285  6722 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:09.277443  6614 consensus_queue.cc:237] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.270932  6932 raft_consensus.cc:2955] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:09.407562  6961 log.cc:927] Time spent T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:14:09.539214  6722 raft_consensus.cc:993] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.539783  6722 raft_consensus.cc:1081] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.550120  4360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:09.550794  4360 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.551230  4360 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.565691  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8f3e66082564439be8a3b4a0292e958 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:09.566246  6932 raft_consensus.cc:993] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.572693  6803 raft_consensus.cc:1081] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.575893  4360 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.585527  6940 raft_consensus.cc:993] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.586110  6940 raft_consensus.cc:1081] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.583776  6803 raft_consensus.cc:993] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.587270  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:09.587502  6803 raft_consensus.cc:1081] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:09.587873  4511 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.592417  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:09.593006  4433 raft_consensus.cc:3055] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:09.593292  4433 raft_consensus.cc:740] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:09.594022  4433 consensus_queue.cc:260] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.595541  4433 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.602277  4433 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:09.606283  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:09.606890  5025 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.604015  4361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:09.611385  4361 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.611857  4361 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.618180  6932 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:09.605306  4360 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:09.618780  6932 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.624555  4357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:09.625172  4357 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.625578  4357 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.625361  4263 catalog_manager.cc:5697] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.627043  4263 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 5 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.630365  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:09.631683  4363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:09.632284  4363 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.632542  6932 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:09.632666  4363 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.635007  4357 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.636813  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:09.637542  4362 raft_consensus.cc:2368] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:09.641713  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:09.641799  4363 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.642529  4433 raft_consensus.cc:3055] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:09.643036  4433 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:09.652422  4433 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.660195  4433 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.665412  4407 leader_election.cc:400] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:09.665798  4407 leader_election.cc:403] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:09.668260  4363 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:09.671530  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:09.679100  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:09.679368  4440 raft_consensus.cc:3055] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.679698  4513 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.679900  4263 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.671952  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:09.681777  4263 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196), pending config changed. New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.679698  4440 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:09.684676  4440 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.684937  4263 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.685935  4440 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.693317  4440 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:09.677517  4433 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:09.677819  4357 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:09.635905  5025 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:09.683262  4506 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.697158  4332 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:09.698109  4332 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:09.698244  4330 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:09.698943  6918 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:09.699486  6918 raft_consensus.cc:697] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:09.699658  6714 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.700237  6714 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:09.700453  6918 consensus_queue.cc:237] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.701092  6714 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.672298  6851 raft_consensus.cc:3060] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.703197  6749 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:09.706915  4506 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:09.710727  6749 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:09.711984  6749 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.676705  4361 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.714373  4358 raft_consensus.cc:1240] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:09.719327  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:09.719755  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:09.719949  5025 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.719938  6137 consensus_queue.cc:1059] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:09.723400  4433 raft_consensus.cc:3055] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:09.723822  4433 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:09.724697  4433 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.727108  4433 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:09.731330  6851 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:09.695080  4511 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:09.693317  4513 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:09.735487  4361 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:09.735936  4440 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:09.737957  6770 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:09.754124  4433 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:09.760020  5025 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:09.760368  4361 raft_consensus.cc:1275] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:09.762300  4330 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:09.766232  6918 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:09.766917  6918 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:09.768039  6918 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:09.763607  6803 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:09.779688  6770 consensus_queue.cc:1048] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:09.783213  4263 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 145) took 2387 ms. Trace:
I20260709 12:14:09.783728  4263 rpcz_store.cc:276] 0709 12:14:07.395966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.396297 (+   331us) service_pool.cc:224] Handling call
0709 12:14:09.783123 (+2386826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:09.689545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:09.690044 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:09.690077 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:14:09.690097 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:09.690733 (+   636us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:09.690787 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:09.690813 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:14:09.691383 (+   570us) tablet.cc:701] Row locks acquired
0709 12:14:09.691405 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:14:09.691564 (+   159us) write_op.cc:270] Start()
0709 12:14:09.691682 (+   118us) write_op.cc:276] Timestamp: P: 1783599249691515 usec, L: 0
0709 12:14:09.691701 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:14:09.692409 (+   708us) log.cc:844] Serialized 2425 byte log entry
0709 12:14:09.695744 (+  3335us) op_driver.cc:464] REPLICATION: finished
0709 12:14:09.696263 (+   519us) write_op.cc:301] APPLY: starting
0709 12:14:09.696343 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:09.696516 (+   173us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:09.696612 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:09.741254 (+ 44642us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:09.741637 (+   383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:14:09.741679 (+    42us) write_op.cc:312] APPLY: finished
0709 12:14:09.742108 (+   429us) log.cc:844] Serialized 47 byte log entry
0709 12:14:09.742285 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.742385 (+   100us) write_op.cc:454] Released schema lock
0709 12:14:09.742422 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:09.742773 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.742798 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":217,"mutex_wait_us":60921,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":300,"apply.run_cpu_time_us":5159,"apply.run_wall_time_us":46467,"num_ops":5,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":3159,"prepare.run_wall_time_us":3159,"replication_time_us":3902}]]}
W20260709 12:14:09.818621  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6b40d129d452470ba95c63b1eb11f804 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.819419  6928 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.819985  6928 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.822598  6928 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:09.826072  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:09.826752  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 255) took 4961 ms. Trace:
I20260709 12:14:09.830889  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:09.848562  4361 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:09.850248  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:09.851698  6928 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:09.852150  6928 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.852533  6928 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.846771  4260 rpcz_store.cc:276] 0709 12:14:04.865322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.865520 (+   198us) service_pool.cc:224] Handling call
0709 12:14:09.826672 (+4961152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:09.491093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:09.491932 (+   839us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:09.491984 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:14:09.492014 (+    30us) tablet.cc:662] Decoding operations
0709 12:14:09.493641 (+  1627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:09.493725 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:09.493769 (+    44us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:14:09.531406 (+ 37637us) tablet.cc:701] Row locks acquired
0709 12:14:09.531426 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:09.531574 (+   148us) write_op.cc:270] Start()
0709 12:14:09.531695 (+   121us) write_op.cc:276] Timestamp: P: 1783599249531529 usec, L: 0
0709 12:14:09.531717 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:09.534875 (+  3158us) log.cc:844] Serialized 4374 byte log entry
0709 12:14:09.589689 (+ 54814us) op_driver.cc:464] REPLICATION: finished
0709 12:14:09.608264 (+ 18575us) write_op.cc:301] APPLY: starting
0709 12:14:09.608346 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:09.608594 (+   248us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:09.608698 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:09.611036 (+  2338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:09.611306 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:14:09.611355 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:09.611740 (+   385us) log.cc:844] Serialized 83 byte log entry
0709 12:14:09.611919 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.612058 (+   139us) write_op.cc:454] Released schema lock
0709 12:14:09.612119 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:09.612506 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.612553 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63629,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":18316,"apply.run_cpu_time_us":3201,"apply.run_wall_time_us":4204,"num_ops":11,"prepare.queue_time_us":95478,"prepare.run_cpu_time_us":5863,"prepare.run_wall_time_us":116302,"replication_time_us":57805,"thread_start_us":119123,"threads_started":2}]]}
I20260709 12:14:09.835783  4261 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 2 to 3, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193), VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194), VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195), VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:09.897423  4261 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 6, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:09.899585  4261 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 3 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.904639  4261 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.909574  4261 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 7, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:09.914893  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.921926  4261 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 1 to 2, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:09.931120  6921 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.933264  6921 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.936528  6921 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:09.941437  6937 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:09.942006  6937 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.943588  5025 consensus_queue.cc:237] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.944275  6937 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:09.947849  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:09.948635  4361 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:09.946826  6921 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:09.949759  6921 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:09.951969  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:09.952725  4357 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:09.956451  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:09.957116  4436 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:09.946807  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:09.960685  6921 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:09.961155  4511 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:09.963003  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:09.963958  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.967216  6851 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:09.967621  6851 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:09.967981  6851 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.971329  6928 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:09.980233  6928 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:09.986367  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:09.988462  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:09.990123  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:09.991231  4357 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.993010  6928 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:09.993494  6928 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.993848  6928 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:09.996758  4481 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:09.997937  6929 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:10.004475  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:10.005111  4436 raft_consensus.cc:1813] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Handling vote request from an unknown peer a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:10.005566  4436 raft_consensus.cc:2393] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:10.009771  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:10.013585  6851 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.017318  6928 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.019855  6851 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:10.025998  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:10.026831  4510 raft_consensus.cc:2368] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:10.030517  6714 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:10.031139  6714 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:10.033699  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:10.034452  4361 raft_consensus.cc:2393] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 6: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:10.035995  6714 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:10.037633  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:10.038357  5030 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:10.036077  4406 leader_election.cc:400] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:10.039836  4406 leader_election.cc:403] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:14:10.039731  4330 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:10.040884  6714 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:10.041320  6714 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:10.042191  6714 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:10.046723  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 53553.9us
I20260709 12:14:10.047489  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:10.048476  4511 raft_consensus.cc:2393] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:10.057863  6714 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:10.058758  6937 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.063995  4510 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:10.069200  6928 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:10.069769  4358 raft_consensus.cc:1275] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:10.062103  4357 raft_consensus.cc:2468] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:10.074965  6918 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.101476  6918 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.102475  6868 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:10.103837  6918 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:10.075995  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:10.076596  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:10.104705  4361 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.107327  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:10.079977  4263 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 4 to 6, term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to <none>, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 4 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:10.086205  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45316 (request call id 234) took 1158 ms. Trace:
I20260709 12:14:10.113354  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:10.114106  4436 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:10.114744  6868 consensus_queue.cc:1048] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:10.118768  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:10.120105  6749 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:10.120536  6749 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.120909  6749 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.128850  4481 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:10.130124  6929 raft_consensus.cc:2804] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:10.130874  6929 raft_consensus.cc:697] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:10.131721  6929 consensus_queue.cc:237] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.135972  6763 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:10.138137  4357 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:10.142004  6749 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.142900  4511 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:10.143796  4361 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:10.135082  6937 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537) with higher term. Message: Invalid argument: T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7.
I20260709 12:14:10.157964  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:10.158797  4511 raft_consensus.cc:2393] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f6e8442c230466296caa54a80810609 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:10.161791  4433 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:10.167320  4263 catalog_manager.cc:5697] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 4 to 7, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.171850  4263 catalog_manager.cc:5697] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 5 to 6, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.194067  4436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:10.194856  4436 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.203048  4249 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f841988974fd4cd9a66ea124b9b9b284 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:10.111315  4261 rpcz_store.cc:276] 0709 12:14:08.928282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.928470 (+   188us) service_pool.cc:224] Handling call
0709 12:14:08.941008 (+ 12538us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5400002438. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253eabe43 00007f1253faa04e 00007f125246b2a4 00007f125246b232 00007f125246b161 00007f125246b0dc 00007f125246a392 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:14:10.086118 (+1145110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:09.962857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:09.963400 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:09.963433 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:14:09.963449 (+    16us) tablet.cc:662] Decoding operations
0709 12:14:09.965223 (+  1774us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:09.965546 (+   323us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:09.965580 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:14:09.966170 (+   590us) tablet.cc:701] Row locks acquired
0709 12:14:09.966184 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:09.966318 (+   134us) write_op.cc:270] Start()
0709 12:14:09.966430 (+   112us) write_op.cc:276] Timestamp: P: 1783599249966276 usec, L: 0
0709 12:14:09.966454 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:09.967323 (+   869us) log.cc:844] Serialized 2893 byte log entry
0709 12:14:09.969713 (+  2390us) op_driver.cc:464] REPLICATION: finished
0709 12:14:09.970043 (+   330us) write_op.cc:301] APPLY: starting
0709 12:14:09.970115 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:09.970298 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:09.970406 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:09.971221 (+   815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:09.971417 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:14:09.971461 (+    44us) write_op.cc:312] APPLY: finished
0709 12:14:09.971748 (+   287us) log.cc:844] Serialized 59 byte log entry
0709 12:14:09.971923 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.972058 (+   135us) write_op.cc:454] Released schema lock
0709 12:14:09.972105 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:09.972476 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:09.972508 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1673,"reported_tablets":28,"spinlock_wait_cycles":9022720,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":2384,"apply.run_wall_time_us":2383,"num_ops":7,"prepare.queue_time_us":711,"prepare.run_cpu_time_us":3558,"prepare.run_wall_time_us":4779,"replication_time_us":3171,"spinlock_wait_cycles":25984}]]}
I20260709 12:14:10.211238  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet a8f3e66082564439be8a3b4a0292e958 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36570
I20260709 12:14:10.216104  6982 tablet_replica.cc:333] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:10.217707  6982 raft_consensus.cc:2243] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:10.217749  4433 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:10.219837  6982 raft_consensus.cc:2272] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:10.163918  6932 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:10.165723  6749 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:10.166590  6970 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:10.227061  6932 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.167927  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:10.228271  4513 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:10.229328  6932 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:10.231792  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:10.221454  6918 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:10.234201  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:10.235097  4361 raft_consensus.cc:2368] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:10.235750  5025 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:10.236483  5024 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:10.236896  4407 leader_election.cc:400] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:10.237265  4407 leader_election.cc:403] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:10.237702  6982 ts_tablet_manager.cc:1916] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:10.238188  6932 raft_consensus.cc:3060] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.240679  4513 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:10.241892  4331 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:10.248394  6714 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:10.253285  4249 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f841988974fd4cd9a66ea124b9b9b284 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 6
I20260709 12:14:10.162084  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:10.256815  6928 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:10.257768  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 95768.7us
I20260709 12:14:10.258719  4261 catalog_manager.cc:5697] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 5 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:10.264298  4251 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet a8f3e66082564439be8a3b4a0292e958 with cas_config_opid_index 4 failed: Not found: failed to reset TS proxy: No leader found: Tablet a8f3e66082564439be8a3b4a0292e958 consensus state has no leader
I20260709 12:14:10.265859  6727 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:10.266183  6769 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:10.266186  6932 raft_consensus.cc:2749] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) with higher term. Message: Invalid argument: T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8.
I20260709 12:14:10.267592  6769 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:10.227665  4436 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:10.268522  6769 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:10.272105  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:10.276930  4260 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 7 to 8, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:10.353878  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 70743.5us
I20260709 12:14:10.355993  4260 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:10.357512  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 76052us
I20260709 12:14:10.363556  4436 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:10.389601  4436 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:10.413244  4260 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 5 to 7, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:10.454893  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet f841988974fd4cd9a66ea124b9b9b284 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:10.445075  6928 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:10.532403  5024 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:10.533353  4262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45302 (request call id 276) took 1660 ms. Trace:
I20260709 12:14:10.533847  4262 rpcz_store.cc:276] 0709 12:14:08.873252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.873945 (+   693us) service_pool.cc:224] Handling call
0709 12:14:10.533273 (+1659328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52763,"reported_tablets":49,"spinlock_wait_cycles":7424}
I20260709 12:14:10.529285  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:10.562071  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 173349us
I20260709 12:14:10.565331  4330 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:10.608057  6714 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:10.608724  6714 raft_consensus.cc:697] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:10.609875  6714 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:10.554760  6928 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:10.671154  6981 log.cc:927] Time spent T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:14:10.675781  6999 tablet_replica.cc:333] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:10.676394  7003 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:10.709969  4436 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:10.713249  4506 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:10.714108  4433 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:10.717377  4510 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:10.757920  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 152866us
I20260709 12:14:10.769186  6999 raft_consensus.cc:2243] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:10.770193  6999 raft_consensus.cc:2272] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:10.782385  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 164243us
I20260709 12:14:10.734069  6992 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:14:10.739492  7001 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:14:10.968669  6999 ts_tablet_manager.cc:1916] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:10.800158  6727 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 12:14:10.910046  6986 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.045039  6982 ts_tablet_manager.cc:1929] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
W20260709 12:14:11.045742  7014 log.cc:927] Time spent T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:14:11.018293  6986 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:11.045761  6982 log.cc:1199] T a8f3e66082564439be8a3b4a0292e958 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/a8f3e66082564439be8a3b4a0292e958
I20260709 12:14:11.013027  7013 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:14:11.065549  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 88603.1us
W20260709 12:14:11.069557  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 288586us
W20260709 12:14:11.073581  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 293243us
I20260709 12:14:11.092204  4364 raft_consensus.cc:1275] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:11.094085  6986 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:11.099677  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:11.124850  4362 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:11.132084  7021 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:11.140362  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:11.141064  5024 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
W20260709 12:14:11.146699  7019 log.cc:927] Time spent T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:11.180547  4436 raft_consensus.cc:1275] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:11.158774  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet a8f3e66082564439be8a3b4a0292e958 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
W20260709 12:14:11.219344  4250 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 60724.1us
I20260709 12:14:11.234015  4440 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:11.239290  5025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:39134
I20260709 12:14:11.239955  5025 raft_consensus.cc:606] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.290376  6999 ts_tablet_manager.cc:1929] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 12:14:11.235199  7002 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 12:14:11.297511  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 50296.3us
I20260709 12:14:11.242969  7021 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:14:11.299455  4479 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:11.317858  4511 raft_consensus.cc:2955] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:11.350528  7034 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:11.335707  7011 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:11.357985  7011 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.358384  7011 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.371459  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:11.372121  4432 raft_consensus.cc:606] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.378836  4434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:11.379457  4434 raft_consensus.cc:606] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.382308  4434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:11.382930  4434 raft_consensus.cc:606] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.387703  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:11.388803  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 256) took 1270 ms. Trace:
I20260709 12:14:11.389477  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:11.390437  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.401904  6986 consensus_queue.cc:1048] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:11.402596  7010 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:11.403260  7010 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.405830  7010 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:11.417613  7000 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:11.418300  7000 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.421207  7000 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:11.335848  6999 log.cc:1199] T f841988974fd4cd9a66ea124b9b9b284 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/f841988974fd4cd9a66ea124b9b9b284
I20260709 12:14:11.389168  4260 rpcz_store.cc:276] 0709 12:14:10.118150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.118279 (+   129us) service_pool.cc:224] Handling call
0709 12:14:11.388742 (+1270463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:10.569196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:10.677549 (+108353us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:10.677596 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:14:10.677618 (+    22us) tablet.cc:662] Decoding operations
0709 12:14:10.678252 (+   634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:10.678331 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:10.678366 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:10.678767 (+   401us) tablet.cc:701] Row locks acquired
0709 12:14:10.678790 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:14:10.678956 (+   166us) write_op.cc:270] Start()
0709 12:14:10.679115 (+   159us) write_op.cc:276] Timestamp: P: 1783599250678900 usec, L: 0
0709 12:14:10.679141 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:14:10.679871 (+   730us) log.cc:844] Serialized 1304 byte log entry
0709 12:14:10.682187 (+  2316us) op_driver.cc:464] REPLICATION: finished
0709 12:14:10.682643 (+   456us) write_op.cc:301] APPLY: starting
0709 12:14:10.682734 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:10.682891 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:10.683008 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:10.683461 (+   453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:10.683643 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:10.683694 (+    51us) write_op.cc:312] APPLY: finished
0709 12:14:10.683920 (+   226us) log.cc:844] Serialized 35 byte log entry
0709 12:14:10.684085 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:10.684189 (+   104us) write_op.cc:454] Released schema lock
0709 12:14:10.684229 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:10.684541 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:10.684570 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158036,"reported_tablets":19,"spinlock_wait_cycles":87424,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":1869,"apply.run_wall_time_us":1869,"num_ops":3,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":3728,"prepare.run_wall_time_us":117698,"replication_time_us":2914}]]}
I20260709 12:14:11.441977  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:11.443110  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:11.444098  4511 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:11.428409  4262 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:11.453127  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6b40d129d452470ba95c63b1eb11f804 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:11.460716  6999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46914 (request call id 82) took 1007 ms. Trace:
I20260709 12:14:11.461223  6999 rpcz_store.cc:276] 0709 12:14:10.454206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.454561 (+   355us) service_pool.cc:224] Handling call
0709 12:14:10.675284 (+220723us) ts_tablet_manager.cc:1151] Deleting tablet f841988974fd4cd9a66ea124b9b9b284
0709 12:14:10.675358 (+    74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:14:11.166929 (+491571us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:11.290167 (+123238us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:11.460626 (+170459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":219516,"thread_start_us":119735,"threads_started":1}
I20260709 12:14:11.473951  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet f841988974fd4cd9a66ea124b9b9b284 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:11.485368  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:11.489971  5025 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:11.497165  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:11.498145  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.503556  7018 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.511159  7005 raft_consensus.cc:993] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:11.482952  6918 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:14:11.511857  7005 raft_consensus.cc:1081] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:11.524725  4363 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:11.504209  6932 raft_consensus.cc:993] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
W20260709 12:14:11.567425  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 65048.2us
I20260709 12:14:11.556099  7000 raft_consensus.cc:993] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:11.565784  6851 raft_consensus.cc:1081] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:11.541101  6921 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:14:11.619815  7000 raft_consensus.cc:1081] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
W20260709 12:14:11.636469  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 48364.1us
I20260709 12:14:11.670553  4407 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:11.670553  7039 log.cc:927] Time spent T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:14:11.673854  4364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:11.674602  4364 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.675050  4364 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.675182  6137 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:11.676697  6137 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:11.683585  5025 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:11.585366  7001 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:14:11.677759  6940 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.717240  6137 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:11.722965  7011 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:11.725616  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:11.732769  4364 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.735496  4364 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:11.737849  4511 raft_consensus.cc:1240] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.760084  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:11.760950  5024 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.753377  7011 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:11.817447  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:11.817608  4364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:11.818408  4364 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:11.818821  4364 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:11.815964  7043 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260709 12:14:11.836831  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:11.837584  4511 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:11.833807  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 160612us
I20260709 12:14:11.841930  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:11.850517  4407 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.857504  5024 raft_consensus.cc:2468] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:14:11.862567  4364 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.873083  4511 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:11.885447  4364 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:11.859134  7048 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:11.897145  4479 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:11.844256  6769 consensus_queue.cc:1059] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:14:11.885949  6770 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.909370  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:11.910084  4437 raft_consensus.cc:3055] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:11.910382  4437 raft_consensus.cc:740] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:11.912911  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:11.923381  4437 consensus_queue.cc:260] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.929915  4510 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.941697  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:11.942557  4434 raft_consensus.cc:3055] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.942945  4434 raft_consensus.cc:740] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:11.965209  4437 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:11.988735  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 80980.7us
I20260709 12:14:11.989615  4331 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:11.973891  4434 consensus_queue.cc:260] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:11.914057  6987 raft_consensus.cc:2804] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:12.052690  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 63164us
I20260709 12:14:12.048776  6987 raft_consensus.cc:697] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:11.939361  6770 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.089597  4438 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:12.067839  7022 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.127260  7022 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:12.128262  7022 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.038920  6749 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:14:12.091778  6987 consensus_queue.cc:237] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.095482  6770 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:12.099339  4251 catalog_manager.cc:4810] Async tablet task ChangeConfig:REMOVE_PEER RPC for tablet a8f3e66082564439be8a3b4a0292e958 with cas_config_opid_index 4 failed: Not found: failed to reset TS proxy: No leader found: Tablet a8f3e66082564439be8a3b4a0292e958 consensus state has no leader
I20260709 12:14:12.142763  4437 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:12.163910  4365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:12.164572  4365 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.164951  4365 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:12.122973  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 52650.9us
I20260709 12:14:12.197304  6918 raft_consensus.cc:3055] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:12.197808  6918 raft_consensus.cc:740] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:12.203102  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:12.205935  4510 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:12.210916  4365 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.233011  4362 raft_consensus.cc:1240] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:12.258155  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:12.276322  6804 raft_consensus.cc:993] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:12.276933  7057 raft_consensus.cc:1081] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:12.277897  6804 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 3 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:12.198660  6918 consensus_queue.cc:260] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.281915  6918 raft_consensus.cc:3060] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:12.308727  6932 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:12.309427  6932 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.313874  4260 catalog_manager.cc:5697] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:12.316922  4260 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:12.319322  4260 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 5 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:12.378947  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:12.388536  4509 raft_consensus.cc:1240] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:12.418715  4997 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:12.405221  6932 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.423020  7030 raft_consensus.cc:493] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:12.459342  4361 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:12.473397  4364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:53846
W20260709 12:14:12.496096  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.563505  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 81590.4us
I20260709 12:14:12.448300  6804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39674 (request call id 2) took 2211 ms. Trace:
W20260709 12:14:12.565584  4406 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.565794  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 85136.9us
I20260709 12:14:12.620461  4364 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.621059  4364 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:12.657411  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 186698us
I20260709 12:14:12.483280  7027 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.177s
W20260709 12:14:12.675626  7076 log.cc:927] Time spent T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 12:14:12.676985  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.701196  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 221616us
W20260709 12:14:12.701676  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6b40d129d452470ba95c63b1eb11f804 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:12.467469  7030 raft_consensus.cc:515] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.705511  4434 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:12.710143  4364 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.684087  4438 raft_consensus.cc:2955] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 3 to 6, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:12.653935  6937 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:12.654232  6970 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:14:12.704649  7053 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:12.699389  6928 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
W20260709 12:14:12.762549  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 57381.8us
I20260709 12:14:12.730875  7011 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:12.745764  6970 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:12.784912  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 164146us
I20260709 12:14:12.745841  6937 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.786039  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:12.791985  7005 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:12.801872  4434 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 5.
I20260709 12:14:12.796542  7024 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:12.779410  6928 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.821280  6970 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:12.822099  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:12.822657  6928 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.824484  6937 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:12.838138  7079 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:14:12.839291  7010 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:12.839905  7010 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.843705  7010 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.805099  7011 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.830295  7057 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:12.846304  7011 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:12.819057  7030 leader_election.cc:290] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.826970  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:12.849696  6918 consensus_meta.cc:287] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.003s
I20260709 12:14:12.852833  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:12.853585  4507 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:12.616436  6804 rpcz_store.cc:276] 0709 12:14:10.233377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.233525 (+   148us) service_pool.cc:224] Handling call
0709 12:14:10.240609 (+  7084us) log.cc:844] Serialized 494 byte log entry
0709 12:14:12.440448 (+2199839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10693,"raft.queue_time_us":7898,"raft.run_cpu_time_us":5196,"raft.run_wall_time_us":190497,"thread_start_us":29951,"threads_started":1,"wal-append.queue_time_us":28486,"wal-append.run_cpu_time_us":5853,"wal-append.run_wall_time_us":1010794}
I20260709 12:14:12.811666  7005 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.863348  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:12.871471  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:12.838333  7024 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.926486  7090 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:12.930320  7090 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.933043  7090 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:12.937167  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:12.943439  4364 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.945685  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:12.947980  5025 raft_consensus.cc:3055] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:12.948518  5025 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:12.952827  7005 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:12.949586  5025 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:12.955579  5025 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:12.963562  7024 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:12.966321  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:12.970263  6986 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:12.971114  6986 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:12.975992  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:12.973887  6986 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:12.980269  5025 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 8.
W20260709 12:14:12.995469  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 287479us
W20260709 12:14:13.004317  4996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.001233  6986 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:13.018097  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:13.020447  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.021920  4439 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:13.023969  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.024785  5025 raft_consensus.cc:1813] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Handling vote request from an unknown peer a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.026361  5025 raft_consensus.cc:2393] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 8: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:13.026453  4406 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:13.043457  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.048017  5025 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:13.026228  6921 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.017052  7030 consensus_queue.cc:1059] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:14:13.021826  6986 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.056223  7010 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:13.050307  7096 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.058557  7096 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.058923  7096 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.061236  4438 raft_consensus.cc:3055] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:13.061625  4438 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:13.062343  4438 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.053680  6921 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.063691  4249 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c0ed95ce6be4de980a07c4834b46498 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:13.053845  7028 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.087378  6921 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.087267  7028 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.089576  4438 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:13.070521  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.068070  6986 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:13.089988  7028 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:13.090399  7080 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.329s	user 0.005s	sys 0.000s
I20260709 12:14:13.091637  4432 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:13.097522  4330 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:13.076455  7096 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.110847  4365 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.107110  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:13.109654  7092 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:14:13.116382  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.117727  4437 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 2.
I20260709 12:14:13.119263  4332 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:13.127923  4435 raft_consensus.cc:1240] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:13.130100  6714 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:13.131507  7072 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:13.132066  7072 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:13.132956  7072 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.133615  4262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 149) took 1730 ms. Trace:
I20260709 12:14:13.133919  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:13.125540  7077 log.cc:927] Time spent T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.344s	user 0.000s	sys 0.002s
I20260709 12:14:13.137941  4358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36692 (request call id 1877) took 1653 ms. Trace:
I20260709 12:14:13.138383  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abe6120f15d41dd8f67749ea3529089" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.142273  4514 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:13.143414  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.145720  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.146369  4513 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:13.147476  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.148617  4363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.148759  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.149050  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.149624  4365 raft_consensus.cc:2393] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 4: Already voted for candidate 6f6e8442c230466296caa54a80810609 in this term.
I20260709 12:14:13.150707  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.151338  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.134038  4262 rpcz_store.cc:276] 0709 12:14:11.403384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.411728 (+  8344us) service_pool.cc:224] Handling call
0709 12:14:13.133556 (+1721828us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:11.720071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:11.793261 (+ 73190us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:11.793304 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:14:11.793321 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:11.793703 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:11.793775 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:11.793807 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:11.794002 (+   195us) tablet.cc:701] Row locks acquired
0709 12:14:11.794018 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:14:11.794173 (+   155us) write_op.cc:270] Start()
0709 12:14:11.794282 (+   109us) write_op.cc:276] Timestamp: P: 1783599251794123 usec, L: 0
0709 12:14:11.794304 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:11.795068 (+   764us) log.cc:844] Serialized 533 byte log entry
0709 12:14:12.668612 (+873544us) op_driver.cc:464] REPLICATION: finished
0709 12:14:12.944084 (+275472us) write_op.cc:301] APPLY: starting
0709 12:14:12.944180 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:12.944290 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:12.944418 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:12.944697 (+   279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:12.944873 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:14:12.944966 (+    93us) write_op.cc:312] APPLY: finished
0709 12:14:12.945219 (+   253us) log.cc:844] Serialized 23 byte log entry
0709 12:14:12.945410 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.945487 (+    77us) write_op.cc:454] Released schema lock
0709 12:14:12.945531 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:12.945934 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.945964 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":243988,"apply.run_cpu_time_us":1856,"apply.run_wall_time_us":1856,"num_ops":1,"prepare.queue_time_us":244910,"prepare.run_cpu_time_us":14678,"prepare.run_wall_time_us":172087,"raft.queue_time_us":436159,"raft.run_cpu_time_us":34657,"raft.run_wall_time_us":432259,"replication_time_us":830748,"spinlock_wait_cycles":28032,"thread_start_us":708820,"threads_started":4,"wal-append.queue_time_us":86646}]]}
I20260709 12:14:13.153769  4481 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:13.160741  4438 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:13.163357  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:13.221149  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 63886.4us
W20260709 12:14:13.226615  7080 log.cc:927] Time spent T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:14:13.227190  7030 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:14:13.227073  4515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414c481bb7ad485898e5ed66d8a38344" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.228662  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:13.235380  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 76243us
W20260709 12:14:13.238533  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 65326.8us
I20260709 12:14:13.129108  7028 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:13.138298  4358 rpcz_store.cc:276] 0709 12:14:11.484455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.484844 (+   389us) service_pool.cc:224] Handling call
0709 12:14:11.485196 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.491749 (+  6553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:11.491782 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:11.499409 (+  7627us) log.cc:844] Serialized 26 byte log entry
0709 12:14:12.200575 (+701166us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180037d3e0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d0d1 00007f124e0a8a0f
0709 12:14:12.434662 (+234087us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:12.434697 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:12.434754 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.124836 (+690082us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:14:13.137727 (+ 12891us) raft_consensus.cc:1685] finished
0709 12:14:13.137749 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.137859 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38240,"raft.queue_time_us":9647,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":4833,"spinlock_wait_cycles":9805952,"thread_start_us":233911,"threads_started":1,"wal-append.queue_time_us":1156659}
I20260709 12:14:13.249040  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:13.249675  4509 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:13.252663  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:13.253638  4481 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:13.255128  7028 raft_consensus.cc:697] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:13.255326  6929 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:13.255722  6929 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.256099  6929 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:13.256132  7028 consensus_queue.cc:237] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.241190  6137 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:13.255170  7090 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.259086  6137 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.259577  7090 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:13.259969  7090 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.261379  6137 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.243515  4331 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.152496  6714 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:13.201349  7002 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:13.277547  4481 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:13.268792  6970 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:13.279800  7001 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:13.288904  7090 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.292980  6714 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.295717  6714 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.222548  4406 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:13.296702  7005 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.297108  7005 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:13.297465  7005 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.297626  4332 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:13.300447  7072 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:13.300943  7072 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:13.301796  7072 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:13.307693  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 85222.5us
I20260709 12:14:13.317917  4509 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
W20260709 12:14:13.329258  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 51900.8us
I20260709 12:14:13.337365  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.338048  4407 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:13.331679  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:13.350693  4481 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:13.359185  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:13.336241  6986 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.333097  7090 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:13.376821  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.377061  7062 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.360445  7085 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:13.388643  7090 raft_consensus.cc:2749] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:13.370585  7058 raft_consensus.cc:2749] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:13.395772  6989 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:13.396667  6989 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.412883  7096 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.414083  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:13.421361  7005 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.383800  6929 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.434592  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:14:13.452322  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 96725.8us
I20260709 12:14:13.461391  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:13.462060  4438 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:13.461015  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 102278us
I20260709 12:14:13.465174  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:13.468567  4438 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 8.
I20260709 12:14:13.475091  4406 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.479236  6137 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:13.480933  4406 leader_election.cc:304] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.462113  6989 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.488057  4406 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.485545  6714 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.509531  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.507380  4366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:13.489027  7096 raft_consensus.cc:2749] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.514446  6137 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:13.537092  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:13.512042  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.534709  7109 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:13.540938  4406 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.547108  4435 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.548002  7110 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:13.547366  7109 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.553011  7110 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.547953  6992 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.557195  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.557142  6992 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.536634  7005 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.558831  7037 consensus_queue.cc:1059] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:13.559999  7037 raft_consensus.cc:3055] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:13.560338  7037 raft_consensus.cc:740] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:13.561148  7037 consensus_queue.cc:260] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.513479  6929 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.561908  7002 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.569540  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:13.562595  7037 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.573494  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:13.577359  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:13.583468  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:13.590312  4433 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 6: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:14:13.549002  7046 raft_consensus.cc:2749] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.536442  6714 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.631335  4406 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.583837  7110 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.719875  4364 raft_consensus.cc:1275] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:14:13.720429  4364 pending_rounds.cc:85] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Aborting all ops after (but not including) 5
I20260709 12:14:13.720714  4364 pending_rounds.cc:107] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:14:13.721014  4364 raft_consensus.cc:2889] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:13.724510  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.726037  6928 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.726861  6928 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.708900  7095 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.584268  6989 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:13.710455  6992 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.714059  6714 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.913019  6989 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.915547  6989 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.891836  7062 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
W20260709 12:14:13.880327  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 115150us
I20260709 12:14:13.916424  7062 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:13.917954  5023 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:13.918869  7062 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:13.872004  6928 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.887635  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.920626  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:13.922039  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.925205  6714 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:13.927731  4438 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:13.932932  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:13.942679  4261 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:13.945326  4261 catalog_manager.cc:5697] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:13.948762  4261 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.973589  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:13.958140  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:13.965862  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45316 (request call id 235) took 2492 ms. Trace:
W20260709 12:14:13.973016  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 216511us
I20260709 12:14:13.950747  4261 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:13.980557  4407 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:13.985246  6722 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.985823  6769 raft_consensus.cc:493] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:13.986362  6769 raft_consensus.cc:515] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:13.989950  6769 leader_election.cc:290] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:13.994709  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:13.998281  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:14.000335  4479 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:14.005198  4406 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.013540  7109 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:14.014549  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:14.014758  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:13.967581  4260 rpcz_store.cc:276] 0709 12:14:11.473531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.482316 (+  8785us) service_pool.cc:224] Handling call
0709 12:14:13.965794 (+2483478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:12.415594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:12.658853 (+243259us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:12.662929 (+  4076us) write_op.cc:435] Acquired schema lock
0709 12:14:12.670307 (+  7378us) tablet.cc:662] Decoding operations
0709 12:14:12.791246 (+120939us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:12.791315 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:12.791362 (+    47us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:12.791837 (+   475us) tablet.cc:701] Row locks acquired
0709 12:14:12.791864 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:14:12.792057 (+   193us) write_op.cc:270] Start()
0709 12:14:12.792214 (+   157us) write_op.cc:276] Timestamp: P: 1783599252791997 usec, L: 0
0709 12:14:12.792248 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:14:12.958126 (+165878us) log.cc:844] Serialized 1308 byte log entry
0709 12:14:12.961186 (+  3060us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400399c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0e8e28 00007f1251b23581 00007f1251b22d58 00007f1251b279f1 00007f1251b279a9 00007f1251b27939 00007f1251b27901 00007f1251b26b2d 0000000000388634 0000000000388479
0709 12:14:12.967220 (+  6034us) op_driver.cc:464] REPLICATION: finished
0709 12:14:12.968013 (+   793us) write_op.cc:301] APPLY: starting
0709 12:14:12.968096 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:12.968237 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:12.968260 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:12.968718 (+   458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:12.968914 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:12.968974 (+    60us) write_op.cc:312] APPLY: finished
0709 12:14:12.969690 (+   716us) log.cc:844] Serialized 35 byte log entry
0709 12:14:12.969871 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.969972 (+   101us) write_op.cc:454] Released schema lock
0709 12:14:12.970011 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:12.976633 (+  6622us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:12.976666 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":161706,"reported_tablets":9,"spinlock_wait_cycles":4480,"child_traces":[["op",{"apply.queue_time_us":549,"apply.run_cpu_time_us":2387,"apply.run_wall_time_us":8561,"num_ops":3,"prepare.queue_time_us":4525,"prepare.run_cpu_time_us":9372,"prepare.run_wall_time_us":550652,"replication_time_us":174795,"spinlock_wait_cycles":282906368}]]}
I20260709 12:14:14.024462  4332 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.016130  6921 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:14:14.028573  7119 log.cc:927] Time spent T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:14:14.039705  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:14.057957  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:14.029767  6918 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:14.039269  7062 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.071367  4432 raft_consensus.cc:1275] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:14.069325  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:14.073233  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3568f45f51034aec8216f626ea0759ea" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:14.065389  4510 raft_consensus.cc:1240] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Rejecting Update request from peer 133eea4ce99644f5adbd12c985fc95cb for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:14.040524  6714 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.080753  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:14.085955  4438 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:14.083426  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:14.093947  4481 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:14.096873  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:14.063643  7074 consensus_queue.cc:1059] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:14:14.101763  4510 raft_consensus.cc:1240] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:14.101743  4332 leader_election.cc:304] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:14.104992  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:14.110414  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:14.084780  6928 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.115173  4511 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:14.077256  7072 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:14.112352  7001 raft_consensus.cc:2749] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:14.101969  6769 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:14:14.116155  6997 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.125375  6987 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:14.177289  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 57763.3us
W20260709 12:14:14.161701  7117 log.cc:927] Time spent T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:14:14.118244  6992 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:14:14.181108  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:14.186569  4438 raft_consensus.cc:606] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:14.186960  4438 raft_consensus.cc:614] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:14.135380  6921 consensus_queue.cc:1048] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:14:14.126580  6928 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:14.196607  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 72174us
I20260709 12:14:14.201653  4251 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet a8f3e66082564439be8a3b4a0292e958 with cas_config_opid_index 4: aborting the task: latest config opid_index 6; task opid_index 4
I20260709 12:14:14.219866  5025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:39134
I20260709 12:14:14.220546  5025 raft_consensus.cc:606] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.221339  6928 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:14.221593  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.228747  4331 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.230238  4331 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.230430  7074 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.245028  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:14.245743  4435 raft_consensus.cc:606] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:14.231941  7006 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.249086  7006 consensus_queue.cc:1059] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:14.250778  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:14.252514  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:14.253307  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:14.268383  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:14.217576  7093 consensus_queue.cc:1059] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:14:14.236904  6749 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:14.271340  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:14.272070  6987 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.283766  6714 raft_consensus.cc:3055] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.284317  6714 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:14.285320  6714 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:14.378660  6614 raft_consensus.cc:3055] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:14.379331  6614 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:14.380455  6614 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.382225  6614 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:14.415191  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 179177us
W20260709 12:14:14.425374  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 192376us
I20260709 12:14:14.426225  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:14.429574  7072 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:14.447228  7037 raft_consensus.cc:993] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:14.447737  7037 raft_consensus.cc:1081] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:14.441911  7074 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:14:14.469206  6714 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.469378  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:14.471678  4514 raft_consensus.cc:1275] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:14.484129  7031 raft_consensus.cc:993] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:14.484654  7031 raft_consensus.cc:1081] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:14.502496  4514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:14.503235  4514 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.503675  4514 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.525501  4361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:14.526162  4361 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:14.526538  4361 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.547214  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:14.548724  4361 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:14.547171  4514 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.557251  4361 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:14.557386  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:14.558295  4438 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.561883  4514 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:14.562913  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a04eae5aed3946b19b6d1c1b40af70ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:14.563594  5025 raft_consensus.cc:3055] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.563915  5025 raft_consensus.cc:740] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:14.564800  5025 consensus_queue.cc:260] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.570623  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:14.571295  4511 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.553946  6921 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.576108  5025 raft_consensus.cc:3060] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.582731  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:14.583429  4433 raft_consensus.cc:3055] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.583750  4433 raft_consensus.cc:740] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:14.560437  7006 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:14.588166  4433 consensus_queue.cc:260] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:14.596596  4433 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.602871  4438 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:14.618641  4511 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:14.660925  4433 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:14.669492  4262 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 3 to 6, term changed from 7 to 8, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to <none>, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:14.671409  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 54509.1us
I20260709 12:14:14.674218  4262 catalog_manager.cc:5697] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:14.683447  5025 raft_consensus.cc:2468] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:14.684116  4332 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:14.685171  4479 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:14.684870  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45302 (request call id 277) took 3156 ms. Trace:
I20260709 12:14:14.685830  7028 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:14.695781  7028 raft_consensus.cc:697] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:14.696780  7028 consensus_queue.cc:237] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:14.686255  7099 raft_consensus.cc:2804] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:14.705523  4263 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 257) took 2294 ms. Trace:
I20260709 12:14:14.710515  7099 raft_consensus.cc:697] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:14.722630  4263 rpcz_store.cc:276] 0709 12:14:12.411409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.411528 (+   119us) service_pool.cc:224] Handling call
0709 12:14:14.666970 (+2255442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11311,"reported_tablets":6}
I20260709 12:14:14.723992  7099 consensus_queue.cc:237] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.687178  4261 rpcz_store.cc:276] 0709 12:14:11.528108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.546345 (+ 18237us) service_pool.cc:224] Handling call
0709 12:14:14.684804 (+3138459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:14.149820 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:14.245696 (+ 95876us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:14.248206 (+  2510us) write_op.cc:435] Acquired schema lock
0709 12:14:14.265659 (+ 17453us) tablet.cc:662] Decoding operations
0709 12:14:14.305855 (+ 40196us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:14.305919 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:14.305953 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:14:14.306390 (+   437us) tablet.cc:701] Row locks acquired
0709 12:14:14.306412 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:14:14.306569 (+   157us) write_op.cc:270] Start()
0709 12:14:14.306704 (+   135us) write_op.cc:276] Timestamp: P: 1783599254306523 usec, L: 0
0709 12:14:14.306729 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:14.307451 (+   722us) log.cc:844] Serialized 1742 byte log entry
0709 12:14:14.522164 (+214713us) op_driver.cc:464] REPLICATION: finished
0709 12:14:14.615510 (+ 93346us) write_op.cc:301] APPLY: starting
0709 12:14:14.619346 (+  3836us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:14.619509 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:14.619636 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:14.620156 (+   520us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:14.620568 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:14:14.620617 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:14.636160 (+ 15543us) log.cc:844] Serialized 41 byte log entry
0709 12:14:14.638390 (+  2230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:14.638509 (+   119us) write_op.cc:454] Released schema lock
0709 12:14:14.638562 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:14.643371 (+  4809us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:14.643413 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":388095,"reported_tablets":14,"spinlock_wait_cycles":18176,"child_traces":[["op",{"apply.queue_time_us":89535,"apply.run_cpu_time_us":2525,"apply.run_wall_time_us":31350,"num_ops":4,"prepare.queue_time_us":112862,"prepare.run_cpu_time_us":16204,"prepare.run_wall_time_us":310399,"raft.queue_time_us":48889,"raft.run_cpu_time_us":5912,"raft.run_wall_time_us":35145,"replication_time_us":215294,"thread_start_us":273999,"threads_started":4,"wal-append.queue_time_us":154834}]]}
I20260709 12:14:14.732780  4260 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:14.742425  7086 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:14.743062  7086 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.745288  7086 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:14.749464  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:14.750165  5025 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:14.751394  4479 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:14.752233  6928 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:14.752650  6928 raft_consensus.cc:493] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:14.753026  6928 raft_consensus.cc:3060] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.755957  4262 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37796 (request call id 150) took 1046 ms. Trace:
I20260709 12:14:14.756621  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c0ed95ce6be4de980a07c4834b46498 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36570
I20260709 12:14:14.765529  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:14.766528  4437 raft_consensus.cc:2393] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:14:14.760448  6928 raft_consensus.cc:515] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.776613  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:14:14.782114  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 6f6e8442c230466296caa54a80810609 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:14.763244  4262 rpcz_store.cc:276] 0709 12:14:13.709888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.710027 (+   139us) service_pool.cc:224] Handling call
0709 12:14:13.894874 (+184847us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5400399c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e057090 00007f124e0f5f3a 00007f1253eabe9c 00007f1253faa04e 00007f125246b2a4 00007f125246b232 00007f125246b161 00007f125246b0dc 00007f125246a392 00007f124c42848c 00007f124c4278c6
0709 12:14:14.755895 (+861021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:14.691525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:14.692122 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:14.692165 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:14:14.692190 (+    25us) tablet.cc:662] Decoding operations
0709 12:14:14.692616 (+   426us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:14.692670 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:14.692708 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:14:14.693057 (+   349us) tablet.cc:701] Row locks acquired
0709 12:14:14.693073 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:14:14.693228 (+   155us) write_op.cc:270] Start()
0709 12:14:14.693346 (+   118us) write_op.cc:276] Timestamp: P: 1783599254693178 usec, L: 0
0709 12:14:14.693366 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:14:14.694077 (+   711us) log.cc:844] Serialized 879 byte log entry
0709 12:14:14.695839 (+  1762us) op_driver.cc:464] REPLICATION: finished
0709 12:14:14.696244 (+   405us) write_op.cc:301] APPLY: starting
0709 12:14:14.696324 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:14.696454 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:14.696546 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:14.696835 (+   289us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:14.697027 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:14:14.697070 (+    43us) write_op.cc:312] APPLY: finished
0709 12:14:14.697262 (+   192us) log.cc:844] Serialized 29 byte log entry
0709 12:14:14.697978 (+   716us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:14.698062 (+    84us) write_op.cc:454] Released schema lock
0709 12:14:14.698101 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:14.698412 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:14.698438 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54805,"reported_tablets":4,"spinlock_wait_cycles":23780608,"child_traces":[["op",{"apply.queue_time_us":212,"apply.run_cpu_time_us":1560,"apply.run_wall_time_us":2116,"num_ops":2,"prepare.queue_time_us":1030,"prepare.run_cpu_time_us":2839,"prepare.run_wall_time_us":2840,"replication_time_us":2341}]]}
I20260709 12:14:14.788936  4263 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: leader changed from <none> to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 8 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:14.791914  5025 raft_consensus.cc:2468] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:14.792853  4263 catalog_manager.cc:5697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 5 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:14.794852  4263 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } }
I20260709 12:14:14.796999  4479 leader_election.cc:304] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:14.799424  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19356d2adb334f6fa9ec07c452d14046" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:14.800555  4437 raft_consensus.cc:2393] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 5: Already voted for candidate 6b40d129d452470ba95c63b1eb11f804 in this term.
I20260709 12:14:14.784516  6928 leader_election.cc:290] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:14.803880  7099 raft_consensus.cc:2804] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:14.827597  7099 raft_consensus.cc:697] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:14.833593  7147 tablet_replica.cc:333] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:14.843530  7147 raft_consensus.cc:2243] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:14.844437  7147 raft_consensus.cc:2272] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:14.833745  7099 consensus_queue.cc:237] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:14.874626  4261 catalog_manager.cc:5697] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:14.888016  7147 ts_tablet_manager.cc:1916] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:14.890142  4260 catalog_manager.cc:5697] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:14.942608  4260 catalog_manager.cc:5697] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:14.948323  7147 ts_tablet_manager.cc:1929] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.5
I20260709 12:14:14.949424  7147 log.cc:1199] T 1c0ed95ce6be4de980a07c4834b46498 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/1c0ed95ce6be4de980a07c4834b46498
I20260709 12:14:14.951445  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 1c0ed95ce6be4de980a07c4834b46498 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:15.217381  5025 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:15.222877  4511 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:15.225286  7074 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:15.223582  7099 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:15.242275  4433 raft_consensus.cc:1275] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:15.243899  7099 consensus_queue.cc:1048] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:15.271237  4433 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:15.282359  7074 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:15.376449  4435 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:15.378458  6921 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:15.429538  5025 raft_consensus.cc:1275] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:15.434572  7099 consensus_queue.cc:1048] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:15.479610  7025 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:15.480312  7025 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:15.485355  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:15.485554  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:15.486101  5027 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:14:15.487655  4405 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:15.488543  6932 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:15.488967  6932 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:15.489375  6932 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.486299  4510 raft_consensus.cc:2393] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:15.503135  7025 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:15.529191  6932 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:15.532130  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:15.533273  4510 raft_consensus.cc:2393] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b40d129d452470ba95c63b1eb11f804 in current term 3: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:15.539721  6932 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:15.540798  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:15.577759  5025 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:14:15.584237  4405 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:15.598553  6932 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.609440  6932 raft_consensus.cc:697] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:15.610899  6932 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:15.646044  4262 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 2 to 3, leader changed from 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.663514  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.885727  7001 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:15.886333  7001 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:15.889169  7001 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:15.890329  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:15.891150  4435 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:15.892685  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:15.893359  4510 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:15.894841  4331 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:15.896703  7001 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:15.897110  7001 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:15.897480  7001 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:15.915472  4510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:15.916193  4510 raft_consensus.cc:606] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:15.923632  4357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:15.924283  4357 raft_consensus.cc:606] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:15.943804  4364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:15.944624  4364 raft_consensus.cc:606] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:16.001513  4510 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:16.020129  4357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:16.021067  4357 raft_consensus.cc:606] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
W20260709 12:14:16.035627  4479 consensus_peers.cc:597] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4d2f3f375e94f79a0dd385679b944aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.059579  7001 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.064896  4358 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:16.066012  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:16.066660  4435 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.071439  7099 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:16.075045  4358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:16.075671  4358 raft_consensus.cc:606] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:16.076898  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:16.078812  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:16.079638  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.109886  4435 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
W20260709 12:14:16.110457  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 121230us
I20260709 12:14:16.111387  7001 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:16.125200  7099 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.125903  7099 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.129299  7099 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:16.131600  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:16.132711  5025 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 3.
I20260709 12:14:16.134214  4479 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:16.135914  7127 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:16.136420  7127 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.136763  7127 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.148142  7127 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:16.153039  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 77222.3us
I20260709 12:14:16.166025  4332 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:16.167043  7001 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:16.213083  4433 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:16.219069  7001 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.220163  7001 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.224165  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:16.229406  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:16.261790  5025 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:16.265219  7165 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:16.274004  7127 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:16.275556  7130 raft_consensus.cc:993] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.279824  7001 raft_consensus.cc:1081] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
W20260709 12:14:16.283190  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 48740.5us
I20260709 12:14:16.291975  4262 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.302089  4511 raft_consensus.cc:1240] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:16.306663  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 77694.8us
I20260709 12:14:16.310971  7176 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:16.324467  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 92857.6us
I20260709 12:14:16.326808  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
W20260709 12:14:16.341876  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 99736.5us
I20260709 12:14:16.346967  6932 consensus_queue.cc:1059] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:16.348016  6932 raft_consensus.cc:3055] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:16.348392  6932 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:16.349326  6932 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.350657  6932 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:16.387715  7172 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
W20260709 12:14:16.382802  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 285414us
I20260709 12:14:16.408269  4435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c34020fa889c4752979db51ac86d3251"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:16.409235  4435 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.409783  4435 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.490290  4435 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.559716  4435 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:16.585740  7170 raft_consensus.cc:993] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.586297  7170 raft_consensus.cc:1081] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
W20260709 12:14:16.593173  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 175004us
I20260709 12:14:16.593847  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:16.594506  4361 raft_consensus.cc:3055] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:16.594851  4361 raft_consensus.cc:740] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.603220  4361 consensus_queue.cc:260] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.604314  4361 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.611760  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:16.612455  4510 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.607614  7184 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:16.619621  4435 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.643148  4510 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:16.646173  7170 raft_consensus.cc:993] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.646766  7170 raft_consensus.cc:1081] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.647192  4433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:16.647845  4433 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.648530  7187 raft_consensus.cc:993] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:16.648636  7170 raft_consensus.cc:993] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.648259  4433 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.649092  7187 raft_consensus.cc:1081] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:16.649344  6714 raft_consensus.cc:1081] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:16.653254  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:16.653909  4509 raft_consensus.cc:3060] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.674633  4357 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:16.679296  4358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:14:16.680051  4358 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.679167  4438 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:16.680419  4358 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.696483  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:16.697121  4432 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.697539  4432 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.698208  4509 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:16.698967  4512 raft_consensus.cc:1240] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.700448  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:16.707986  4432 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.710216  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.711490  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:16.720510  5025 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:16.729562  4358 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.701071  4438 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.731876  4438 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.718914  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:16.736976  4364 raft_consensus.cc:3055] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:16.672372  4479 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:16.710300  4432 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:16.712857  4433 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.737362  4364 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.742960  4364 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.744439  4364 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:16.744658  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 72385.9us
I20260709 12:14:16.745033  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:16.745698  5023 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:16.742120  4433 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:16.744863  4438 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.755709  4433 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:16.756035  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:16.730593  5025 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 9.
I20260709 12:14:16.756698  4360 raft_consensus.cc:3055] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:16.757081  4360 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.757726  4405 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:16.757860  4360 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.759092  7189 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:16.759339  4360 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.759677  7189 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:16.760684  7189 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.761901  7170 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:16.765467  4438 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:16.765656  4359 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:16.766492  5023 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:16.767656  7185 raft_consensus.cc:2749] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:16.766954  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:16.772419  4357 raft_consensus.cc:3055] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:16.771230  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:16.773106  5027 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.780628  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:16.782557  4511 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.784384  4330 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:16.785807  7170 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:16.791109  4357 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.792553  4357 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.794437  4357 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:16.786620  7170 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:16.808303  7170 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.802822  4360 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:16.802953  4364 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 9.
W20260709 12:14:16.804129  4331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.805980  5027 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
W20260709 12:14:16.807072  4330 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7aa6aedab9d4e14b16124d91af2f154. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:16.795015  4358 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:16.825235  4405 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:16.826154  7025 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:16.826340  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 50904.2us
I20260709 12:14:16.826726  7025 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:16.827371  4406 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:16.827850  7025 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.828517  7177 raft_consensus.cc:2804] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:16.829169  7177 raft_consensus.cc:697] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:16.828356  4438 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:16.832001  4511 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:16.830125  7177 consensus_queue.cc:237] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.738835  4361 raft_consensus.cc:2468] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:16.840652  4357 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:16.848927  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:16.849609  4511 raft_consensus.cc:3055] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:16.849915  4511 raft_consensus.cc:740] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:16.848963  4509 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:16.842947  4406 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:16.854950  6932 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:16.855458  6932 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:16.853670  4511 consensus_queue.cc:260] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:16.856245  6932 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:16.857452  4512 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:16.852913  7130 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:14:16.953430  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 59818.5us
W20260709 12:14:16.960839  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 65325.3us
W20260709 12:14:16.957769  7192 log.cc:927] Time spent T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:14:16.902127  7169 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:14:17.007530  4511 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.099968  4511 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:16.974050  7178 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:14:17.109052  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 124244us
W20260709 12:14:17.115139  7194 log.cc:927] Time spent T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 12:14:17.153422  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 140751us
W20260709 12:14:17.243647  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 267695us
I20260709 12:14:17.295091  5025 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:14:17.306515  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 322291us
I20260709 12:14:17.344271  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.351545  5025 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:17.354984  7209 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:17.363411  7175 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:17.412676  4511 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:17.422165  4506 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:17.432816  5023 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:17.433032  4365 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:17.445040  7211 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:17.510641  7174 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:14:17.514887  7221 ts_tablet_manager.cc:933] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:17.515168  7177 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:14:17.526811  4511 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:17.506219  4260 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 8 to 9, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 9 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:17.548743  6714 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:14:17.542797  7211 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:14:17.629556  4357 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:17.631271  4365 raft_consensus.cc:1275] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:17.657027  4361 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:17.661131  6932 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:14:17.660831  7200 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:14:17.690915  7224 log.cc:927] Time spent T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:17.726058  4509 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:17.730158  4432 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:17.738843  7212 consensus_queue.cc:1048] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:14:17.714437  7175 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:14:17.780680  7200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53838 (request call id 14) took 1019 ms. Trace:
I20260709 12:14:17.781332  7200 rpcz_store.cc:276] 0709 12:14:16.761345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.761482 (+   137us) service_pool.cc:224] Handling call
0709 12:14:16.769247 (+  7765us) log.cc:844] Serialized 499 byte log entry
0709 12:14:17.780528 (+1011281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":277,"raft.run_cpu_time_us":1879,"raft.run_wall_time_us":2296,"thread_start_us":32216,"threads_started":1,"wal-append.queue_time_us":30345}
I20260709 12:14:17.819295  7216 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:17.820106  7216 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:17.849398  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 173919us
I20260709 12:14:17.899641  4263 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 6, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.898692  7221 tablet_copy_client.cc:323] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:14:18.121932  7211 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.214609  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 349684us
I20260709 12:14:18.223591  7211 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:18.226291  7211 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:18.235031  7234 ts_tablet_manager.cc:933] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:14:18.230818  4432 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:18.287364  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:18.336769  5023 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
I20260709 12:14:18.298403  7216 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:18.349682  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 129994us
I20260709 12:14:18.351397  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet e4d2f3f375e94f79a0dd385679b944aa from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:14:18.352241  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet e4d2f3f375e94f79a0dd385679b944aa from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-e4d2f3f375e94f79a0dd385679b944aa
I20260709 12:14:18.352864  7234 tablet_copy_client.cc:323] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
W20260709 12:14:18.346477  7220 log.cc:927] Time spent T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:14:18.383957  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:18.385027  4512 raft_consensus.cc:2393] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 4: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:18.391251  4405 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:14:18.400856  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 471934us
I20260709 12:14:18.414510  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:18.415261  4439 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:18.421856  7188 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.422318  7188 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.422663  7188 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.465148  4525 tablet_copy_source_session.cc:215] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:18.484571  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d2f3f375e94f79a0dd385679b944aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.524786  7188 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:18.531654  7188 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:18.565474  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:18.567924  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:18.576623  4512 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:18.576718  5024 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.559831  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet d7aa6aedab9d4e14b16124d91af2f154 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:14:18.578425  4261 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.587143  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet d7aa6aedab9d4e14b16124d91af2f154 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-d7aa6aedab9d4e14b16124d91af2f154
I20260709 12:14:18.595338  4997 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:18.601238  4376 tablet_copy_source_session.cc:215] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:18.607371  4261 catalog_manager.cc:5697] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.609181  4261 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.616348  7221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44136 (request call id 702) took 1261 ms. Trace:
I20260709 12:14:18.616909  7221 rpcz_store.cc:276] 0709 12:14:17.355416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.356695 (+  1279us) service_pool.cc:224] Handling call
0709 12:14:17.535934 (+179239us) ts_tablet_manager.cc:934] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
0709 12:14:18.481019 (+945085us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:18.600906 (+119887us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:18.601030 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:18.615555 (+ 14525us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:18.615860 (+   305us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:18.616201 (+   341us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:18.616260 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":51315,"tablet-copy.queue_time_us":138907,"thread_start_us":289620,"threads_started":2}
I20260709 12:14:18.618788  7221 tablet_copy_client.cc:806] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
W20260709 12:14:18.618958  4405 consensus_peers.cc:597] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d27bb118c5cf4d81b9951fd5ed73bf31. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:18.619532  7221 tablet_copy_client.cc:670] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:18.621869  5024 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:18.622604  7214 raft_consensus.cc:2764] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:14:18.623271  4405 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:18.627103  7234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7aa6aedab9d4e14b16124d91af2f154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.644732  7250 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:18.645447  7250 raft_consensus.cc:697] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:18.646494  7250 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:18.660070  4357 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:18.662295  7188 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:18.664088  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45306 (request call id 265) took 1102 ms. Trace:
I20260709 12:14:18.668227  4262 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:18.679075  7221 tablet_copy_client.cc:538] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:18.691558  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:18.692219  4512 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.693521  7188 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:18.709147  4514 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:18.714919  4361 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:18.664515  4261 rpcz_store.cc:276] 0709 12:14:17.561822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.562001 (+   179us) service_pool.cc:224] Handling call
0709 12:14:18.664000 (+1101999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:18.612859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:18.613486 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:18.613531 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:14:18.613554 (+    23us) tablet.cc:662] Decoding operations
0709 12:14:18.614277 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:18.614346 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:18.614386 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:18.614806 (+   420us) tablet.cc:701] Row locks acquired
0709 12:14:18.614834 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:14:18.615067 (+   233us) write_op.cc:270] Start()
0709 12:14:18.615187 (+   120us) write_op.cc:276] Timestamp: P: 1783599258614974 usec, L: 0
0709 12:14:18.615214 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:14:18.615963 (+   749us) log.cc:844] Serialized 1303 byte log entry
0709 12:14:18.627297 (+ 11334us) op_driver.cc:464] REPLICATION: finished
0709 12:14:18.629001 (+  1704us) write_op.cc:301] APPLY: starting
0709 12:14:18.629095 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:18.629263 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:18.629430 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:18.629965 (+   535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:18.630237 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:18.630289 (+    52us) write_op.cc:312] APPLY: finished
0709 12:14:18.630521 (+   232us) log.cc:844] Serialized 35 byte log entry
0709 12:14:18.630720 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:18.630817 (+    97us) write_op.cc:454] Released schema lock
0709 12:14:18.630858 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":37504,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":1427,"apply.run_cpu_time_us":2326,"apply.run_wall_time_us":2326,"num_ops":3,"prepare.queue_time_us":181,"prepare.run_cpu_time_us":3473,"prepare.run_wall_time_us":9741,"replication_time_us":11902}]]}
I20260709 12:14:18.732378  4512 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:18.757845  4433 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:14:19.071506  7261 log.cc:927] Time spent T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.166s	user 0.004s	sys 0.000s
I20260709 12:14:19.108047  7221 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
W20260709 12:14:18.883912  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 137136us
W20260709 12:14:18.886703  4405 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f28d6bc26fc4caeac04b56caf240716. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.153731  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 267136us
I20260709 12:14:18.801635  7234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44146 (request call id 762) took 1122 ms. Trace:
I20260709 12:14:19.160991  7234 rpcz_store.cc:276] 0709 12:14:17.668224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.668399 (+   175us) service_pool.cc:224] Handling call
0709 12:14:18.235593 (+567194us) ts_tablet_manager.cc:934] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
0709 12:14:18.625866 (+390273us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:18.705569 (+ 79703us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:18.705724 (+   155us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:18.773437 (+ 67713us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:18.773764 (+   327us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:18.774102 (+   338us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:18.790086 (+ 15984us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1741,"tablet-copy.queue_time_us":192549,"thread_start_us":253385,"threads_started":2}
I20260709 12:14:19.167840  7234 tablet_copy_client.cc:806] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:19.168509  7234 tablet_copy_client.cc:670] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:19.171931  7215 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:19.179579  4506 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:19.214089  7174 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:14:19.253415  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 44274.3us
W20260709 12:14:19.273885  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 77091.9us
I20260709 12:14:19.285807  4508 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:19.276865  4509 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:19.318922  6932 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:19.331610  5024 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:19.339356  4404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.355476  4261 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:19.365605  4361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:19.366323  4361 raft_consensus.cc:606] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:19.376202  7188 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:19.377389  4514 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:19.404000  4361 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:19.374076  7215 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:19.444923  7253 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:19.486105  7253 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:19.504436  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:19.496101  7234 tablet_copy_client.cc:538] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:19.513106  7208 raft_consensus.cc:993] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.513712  7208 raft_consensus.cc:1081] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.496860  7253 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:19.530367  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:19.539451  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:19.543722  7277 ts_tablet_manager.cc:933] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:19.545948  7272 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.532408  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:19.549086  4438 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:19.549618  4438 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:19.567653  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 109192us
W20260709 12:14:19.569339  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 110872us
I20260709 12:14:19.582604  4438 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:19.612210  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 6f6e8442c230466296caa54a80810609 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:19.615713  7177 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:19.630712  4438 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:19.629305  4357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:19.642066  4357 raft_consensus.cc:606] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:19.648034  7277 tablet_copy_client.cc:323] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:19.674453  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:19.679303  5030 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.689154  7287 ts_tablet_manager.cc:933] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:19.689483  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:19.690114  4514 raft_consensus.cc:606] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:19.697606  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:19.698256  4361 raft_consensus.cc:3055] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:19.698559  4361 raft_consensus.cc:740] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:19.704800  7234 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:19.711938  4361 consensus_queue.cc:260] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:19.722024  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet d27bb118c5cf4d81b9951fd5ed73bf31 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:19.722770  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet d27bb118c5cf4d81b9951fd5ed73bf31 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-d27bb118c5cf4d81b9951fd5ed73bf31
I20260709 12:14:19.726821  4361 raft_consensus.cc:3060] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:19.762553  5030 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:19.764904  5027 raft_consensus.cc:1240] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:19.776268  4405 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:19.764472  4357 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:19.796805  7177 raft_consensus.cc:2804] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:19.797425  7177 raft_consensus.cc:697] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:19.798486  7177 consensus_queue.cc:237] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:19.821017  4451 tablet_copy_source_session.cc:215] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:19.835163  4364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:19.835832  4364 raft_consensus.cc:606] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:19.840691  4361 raft_consensus.cc:2468] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:19.863204  7287 tablet_copy_client.cc:323] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:19.880033  4514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:19.880856  4514 raft_consensus.cc:606] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:19.882572  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:19.884550  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.898008  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 1f28d6bc26fc4caeac04b56caf240716 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:19.928004  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 1f28d6bc26fc4caeac04b56caf240716 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-1f28d6bc26fc4caeac04b56caf240716
I20260709 12:14:19.941250  7254 raft_consensus.cc:993] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.941862  7254 raft_consensus.cc:1081] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.946666  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.955516  4440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:19.956162  4440 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:19.956557  4440 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.956851  7255 raft_consensus.cc:993] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.957439  7255 raft_consensus.cc:1081] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:19.968412  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:19.969102  4432 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:19.969528  4432 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.971596  7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d27bb118c5cf4d81b9951fd5ed73bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.971453  4440 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:19.980526  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:19.981102  4514 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.981770  4262 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.983912  4440 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:19.988937  4451 tablet_copy_source_session.cc:215] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:19.996630  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:19.997334  4357 raft_consensus.cc:3055] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:19.997679  4357 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:20.005290  7221 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:20.006534  7221 tablet_bootstrap.cc:492] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:20.007397  7221 ts_tablet_manager.cc:1403] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.900s	user 0.050s	sys 0.007s
I20260709 12:14:20.007208  4357 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.010946  7248 raft_consensus.cc:993] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:20.024839  7185 raft_consensus.cc:1081] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:20.012589  7205 raft_consensus.cc:993] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:20.013032  4357 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.026608  7205 raft_consensus.cc:1081] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:20.028801  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:14:20.029341  4438 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:20.029706  4438 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.021858  4514 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:20.033521  4406 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:20.034312  4364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:14:20.034880  4364 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:20.035281  4364 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.044396  4357 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:20.047895  7287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f28d6bc26fc4caeac04b56caf240716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.051716  7221 raft_consensus.cc:359] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:20.052822  7221 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:20.053638  7221 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:20.048697  7175 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:20.056759  7175 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:20.057811  7175 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.065348  5023 raft_consensus.cc:1217] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:14:20.069648  7221 ts_tablet_manager.cc:1434] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:14:20.049712  4432 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.074390  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-e4d2f3f375e94f79a0dd385679b944aa received from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:20.074940  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-e4d2f3f375e94f79a0dd385679b944aa on tablet e4d2f3f375e94f79a0dd385679b944aa with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:20.090082  4438 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:20.093045  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:20.093729  4357 raft_consensus.cc:3055] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:20.093818  4432 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:20.095201  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:20.094134  4357 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:20.098780  4357 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.100029  4357 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.105095  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:20.105748  4509 raft_consensus.cc:3055] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:20.106041  4509 raft_consensus.cc:740] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:20.102123  4364 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.114364  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:20.115056  5023 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.115394  4438 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:20.106900  4509 consensus_queue.cc:260] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:20.118542  4509 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:20.132908  5023 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:20.138381  4357 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:20.139906  4509 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:20.142604  4406 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:20.146906  4364 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:20.154685  7277 tablet_copy_client.cc:806] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:20.155464  7277 tablet_copy_client.cc:670] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:20.175612  4407 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:20.176472  7177 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.177034  7177 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:20.177989  7177 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.179092  7277 tablet_copy_client.cc:538] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:20.183851  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:20.184518  4438 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.185243  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:20.186825  4509 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:20.187155  4509 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:20.159489  7175 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:20.214800  4438 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:20.217247  4509 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.236941  7234 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:20.237982  7234 tablet_bootstrap.cc:492] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:20.238706  7234 ts_tablet_manager.cc:1403] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.534s	user 0.018s	sys 0.018s
W20260709 12:14:20.247253  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 52491.2us
I20260709 12:14:20.259780  4364 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:20.262830  4332 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:20.252828  4263 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:20.216027  7175 raft_consensus.cc:697] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:20.292439  7175 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:20.279486  7291 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:14:20.282217  4509 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.308153  5023 raft_consensus.cc:1275] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:20.302925  7208 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.312135  7208 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:20.318008  7208 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:20.326354  7287 tablet_copy_client.cc:806] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:20.323251  7273 consensus_queue.cc:1048] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:14:20.341145  4509 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:20.375020  7287 tablet_copy_client.cc:670] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:20.475190  7287 tablet_copy_client.cc:538] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:20.487965  7234 raft_consensus.cc:359] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:20.646970  4260 catalog_manager.cc:5697] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:20.643011  7234 raft_consensus.cc:740] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:20.692914  4364 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:20.773384  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 70054.1us
I20260709 12:14:20.692183  7234 consensus_queue.cc:260] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:20.785240  7277 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:20.785651  7234 ts_tablet_manager.cc:1434] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.547s	user 0.014s	sys 0.021s
W20260709 12:14:20.785967  7234 ts_tablet_manager.cc:1467] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Tablet startup took 547ms
W20260709 12:14:20.775929  7303 log.cc:927] Time spent T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:14:20.803833  5030 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:20.811561  6932 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:20.822953  4509 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:20.786298  7234 ts_tablet_manager.cc:1469] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Trace:
0709 12:14:17.668224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.668399 (+   175us) service_pool.cc:224] Handling call
0709 12:14:18.235593 (+567194us) ts_tablet_manager.cc:934] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
0709 12:14:18.625866 (+390273us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:18.705569 (+ 79703us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:18.705724 (+   155us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:18.773437 (+ 67713us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:18.773764 (+   327us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:18.774102 (+   338us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:18.790086 (+ 15984us) inbound_call.cc:177] Queueing success response
0709 12:14:19.704374 (+914288us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:14:20.254693 (+550319us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:14:20.305315 (+ 50622us) tablet_replica.cc:261] Starting instrumentation
0709 12:14:20.305872 (+   557us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":1741,"raft.queue_time_us":3704,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"tablet-copy.queue_time_us":192549,"tablet-download-pool.queue_time_us":120,"tablet-download-pool.run_cpu_time_us":1227,"tablet-download-pool.run_wall_time_us":303071,"thread_start_us":253385,"threads_started":2}
I20260709 12:14:20.860985  4261 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.865105  4432 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:20.864512  4261 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 5 to 6, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.870796  4514 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:20.870265  4261 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.876524  7264 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:20.880798  4360 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:20.883833  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-d7aa6aedab9d4e14b16124d91af2f154 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:14:20.884414  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-d7aa6aedab9d4e14b16124d91af2f154 on tablet d7aa6aedab9d4e14b16124d91af2f154 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:20.896842  7208 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:20.901193  4509 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:20.933043  7287 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:20.914326  7264 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:14:20.946440  6932 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:20.953130  7310 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:20.997668  4510 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:21.017896  7291 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:21.040434  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 77688.2us
W20260709 12:14:21.066031  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 60609.7us
I20260709 12:14:21.105353  4263 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 6, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.126977  5030 raft_consensus.cc:1217] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
W20260709 12:14:21.154381  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 188848us
W20260709 12:14:21.210821  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 120180us
I20260709 12:14:21.305716  4511 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:21.310601  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:21.318472  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 97421.1us
W20260709 12:14:21.318214  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 133726us
I20260709 12:14:21.420738  7326 raft_consensus.cc:1064] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:21.463948  7326 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:21.542064  7287 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:21.589027  7287 tablet_bootstrap.cc:492] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:21.598872  7277 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:21.615399  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 279320us
I20260709 12:14:21.624233  7287 ts_tablet_manager.cc:1403] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.693s	user 0.060s	sys 0.027s
W20260709 12:14:21.627909  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 265100us
I20260709 12:14:21.663384  7313 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:21.664065  7313 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:21.666340  7313 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:21.689477  4440 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:21.710776  7287 raft_consensus.cc:359] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:21.711925  7287 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:21.712703  7287 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:21.715418  7277 tablet_bootstrap.cc:492] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:21.716388  7277 ts_tablet_manager.cc:1403] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.931s	user 0.032s	sys 0.020s
I20260709 12:14:21.720047  5024 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:21.645680  7209 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:14:21.734007  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:21.739151  4440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:21.739794  4440 raft_consensus.cc:606] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:21.747149  7277 raft_consensus.cc:359] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:21.748979  7277 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:21.751371  7326 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:21.794309  7277 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:21.799357  7287 ts_tablet_manager.cc:1434] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.159s	user 0.006s	sys 0.002s
I20260709 12:14:21.801729  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-1f28d6bc26fc4caeac04b56caf240716 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:21.802378  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-1f28d6bc26fc4caeac04b56caf240716 on tablet 1f28d6bc26fc4caeac04b56caf240716 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:21.811198  4440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:21.811849  4440 raft_consensus.cc:606] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:21.814651  4440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:21.815233  4440 raft_consensus.cc:606] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:21.818202  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:21.818724  4432 raft_consensus.cc:606] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:21.823971  4434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:21.824714  4434 raft_consensus.cc:606] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:21.826187  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:21.828444  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.829453  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.874094  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:21.883829  7319 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:21.893617  7209 raft_consensus.cc:1064] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:21.896632  7209 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:21.902362  7277 ts_tablet_manager.cc:1434] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.186s	user 0.014s	sys 0.008s
I20260709 12:14:21.905519  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-d27bb118c5cf4d81b9951fd5ed73bf31 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:21.906092  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-d27bb118c5cf4d81b9951fd5ed73bf31 on tablet d27bb118c5cf4d81b9951fd5ed73bf31 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:21.933561  7174 raft_consensus.cc:993] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
W20260709 12:14:21.934653  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53197.1us
I20260709 12:14:21.937114  4331 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:21.934562  7174 raft_consensus.cc:1081] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:21.939661  7290 raft_consensus.cc:993] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:21.955273  7215 raft_consensus.cc:993] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:21.955900  7291 raft_consensus.cc:1081] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:21.941457  7188 raft_consensus.cc:1081] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:21.962610  5030 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:21.941681  7254 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.965544  7208 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:21.969374  4357 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:21.970582  4514 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:21.980732  7254 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:21.987775  7175 raft_consensus.cc:993] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:21.988337  7175 raft_consensus.cc:1081] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:21.990581  4509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:21.991202  4509 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:21.991606  4509 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:22.002939  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 43963us
I20260709 12:14:22.006815  4509 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.013940  4434 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:22.017891  7321 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:22.021920  4363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:22.022652  4363 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.023108  4363 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.022687  4357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:22.024215  4357 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.024466  4357 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.024840  4509 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:22.033978  4366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:22.034762  4366 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.035281  4366 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.036515  4357 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.043197  4361 raft_consensus.cc:1240] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:22.045436  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:22.046379  5027 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.047928  4357 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 10 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:22.051249  7273 consensus_queue.cc:1059] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.052464  7273 raft_consensus.cc:3055] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:22.052876  7273 raft_consensus.cc:740] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:22.063982  4440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:22.064742  4440 raft_consensus.cc:3055] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:22.065111  4440 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:22.065939  4440 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.037585  7313 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:14:22.045428  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:22.076071  4360 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.089850  4440 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.092286  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:22.115729  4440 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:22.134485  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:22.054538  7273 consensus_queue.cc:260] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.141634  7248 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:22.180716  4366 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.181731  4361 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.183851  4360 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:22.203624  4366 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:22.207903  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:22.208550  4509 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.198544  7273 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:22.205401  7248 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
W20260709 12:14:22.260874  7342 log.cc:927] Time spent T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:22.267726  7329 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.269419  5030 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.274822  5027 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 10.
I20260709 12:14:22.277714  4363 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.297861  4509 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:22.307993  4363 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:22.311139  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 81648.1us
W20260709 12:14:22.301931  7344 log.cc:927] Time spent T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:14:22.319114  4330 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:22.321805  7254 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:22.322338  7254 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:22.323186  7254 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.338018  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:22.338723  4434 raft_consensus.cc:3055] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.339110  4434 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:22.339967  4434 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.340862  4434 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.353259  4434 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:22.255540  7248 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.400509  4363 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.429648  7332 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.440893  5023 raft_consensus.cc:1217] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:14:22.441601  5027 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.442754  5025 raft_consensus.cc:1217] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:14:22.461468  4432 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 10.
I20260709 12:14:22.465111  4331 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:22.467931  4434 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:22.476832  7341 log.cc:927] Time spent T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:14:22.480329  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:22.481000  4433 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:22.481307  4433 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:22.482031  4433 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.485528  4438 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.492964  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:22.493682  4510 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.495247  4507 raft_consensus.cc:1240] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.506754  7174 raft_consensus.cc:993] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:22.507480  7348 raft_consensus.cc:1081] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
W20260709 12:14:22.510288  4407 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.511319  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 127343us
I20260709 12:14:22.522540  4510 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 8.
I20260709 12:14:22.534665  4261 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.549093  4433 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:22.566427  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 101397us
I20260709 12:14:22.567325  7208 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:22.567966  7208 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:22.568938  7208 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.577176  4510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:22.577844  4510 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.577996  4514 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:22.578258  4510 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.579860  4363 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Rejecting Update request from peer 6b40d129d452470ba95c63b1eb11f804 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:22.592662  4263 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.597846  4433 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 8.
I20260709 12:14:22.611860  4332 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:22.616161  7254 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:22.616895  7254 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:22.618075  7254 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.624457  4510 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.645406  4510 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:22.653856  4434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:22.655223  4434 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:22.655668  4434 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:22.656641  4434 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.658177  4434 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.677451  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:22.678138  4365 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:22.680354  4434 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 9.
I20260709 12:14:22.679946  4510 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.682521  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:22.695508  7205 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:22.696099  7205 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:22.697095  7205 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:22.699467  4262 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.703158  4365 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 9.
I20260709 12:14:22.734141  7348 raft_consensus.cc:1064] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:22.737351  7348 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.747969  4433 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:22.752229  7254 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.799962  5030 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:22.822292  4260 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 9 to 10, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 10 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.834184  4365 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:22.834534  7339 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:22.829826  4260 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 6 to 7, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.837786  7174 raft_consensus.cc:1064] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:22.843434  7174 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.846956  4514 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:22.848611  7290 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:22.859597  7320 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:22.873028  4363 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:22.873989  4366 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.879845  4263 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 8 to 9, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 9 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.889226  5030 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:22.882213  7290 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:14:22.896760  4510 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:22.902297  7363 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:22.915695  7329 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:22.923740  4509 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:22.927932  4261 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 7 to 8, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 8 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.940485  4438 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:22.944839  5025 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:22.954972  5030 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:22.954595  5025 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.944242  7363 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.959419  7254 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.960769  7332 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:22.985255  7248 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:22.987290  7205 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:23.000936  4510 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:23.004583  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7aa6aedab9d4e14b16124d91af2f154 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:23.008428  4363 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:22.998436  4433 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.016852  7189 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:23.026057  4438 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:23.029939  7175 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.036928  5030 raft_consensus.cc:2955] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.047400  4365 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.048651  4510 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.058583  7339 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:14:23.057847  4508 raft_consensus.cc:2955] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.065953  5025 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:23.072615  7290 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:23.074723  7319 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:23.079290  4506 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:23.084306  7178 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:23.088516  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4d2f3f375e94f79a0dd385679b944aa with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:23.095666  4434 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:23.129169  4260 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.144158  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.144366  4260 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:23.200205  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 91279us
W20260709 12:14:23.237995  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 95238.9us
I20260709 12:14:23.239282  5030 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:23.133086  7208 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:14:23.283370  4438 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:23.304680  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 174456us
W20260709 12:14:23.272176  7369 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:14:23.352764  7363 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:23.355140  4514 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:23.463704  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 104875us
W20260709 12:14:23.467367  7362 log.cc:927] Time spent T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:14:23.499176  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 297303us
W20260709 12:14:23.569013  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 60063.2us
W20260709 12:14:23.631105  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 209915us
W20260709 12:14:23.649844  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 79985.1us
I20260709 12:14:23.650067  4514 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:23.668398  7389 log.cc:927] Time spent T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:14:23.670360  7383 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:14:23.671209  7396 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:23.680513  4361 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:23.753607  4357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:23.754544  4357 raft_consensus.cc:606] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
W20260709 12:14:23.766420  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 465143us
I20260709 12:14:23.798873  4434 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:23.841981  4508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:23.848721  4508 raft_consensus.cc:606] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:23.860258  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:14:23.867122  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 49803.5us
I20260709 12:14:23.935045  7395 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:14:23.940727  7409 raft_consensus.cc:993] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:23.941380  7409 raft_consensus.cc:1081] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:23.949587  4361 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:24.020615  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 54216.7us
I20260709 12:14:24.022940  7386 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:24.023763  7386 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:24.026501  7386 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:24.030022  7398 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:24.034046  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 72108.4us
I20260709 12:14:24.023049  7387 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.042361  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:24.049510  7387 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.052058  7387 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:24.070607  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 48786.6us
I20260709 12:14:24.073611  7363 raft_consensus.cc:993] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:24.077140  5027 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:24.083666  7363 raft_consensus.cc:1081] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:24.089752  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:24.092541  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:24.093310  4438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:24.093869  4438 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:24.094249  4438 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.105244  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:24.106217  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:24.109458  4361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36692
I20260709 12:14:24.110015  4361 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:24.110357  4361 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.129179  7348 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:24.159519  4361 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.152839  4406 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:24.168220  4407 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:24.171929  4361 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:24.202911  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 50324.7us
I20260709 12:14:24.207921  4438 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.214181  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:24.215046  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:24.218739  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:24.178167  7291 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.241178  4438 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:24.209262  7188 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.243075  4260 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45302 (request call id 296) took 1141 ms. Trace:
I20260709 12:14:24.244858  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:24.247251  4507 raft_consensus.cc:3055] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:24.247589  4507 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:24.219373  7386 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:24.261512  7386 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.269451  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:24.270161  4441 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:24.279868  7422 log.cc:927] Time spent T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:14:24.253723  4507 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.246210  4260 rpcz_store.cc:276] 0709 12:14:23.101445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.101619 (+   174us) service_pool.cc:224] Handling call
0709 12:14:24.242968 (+1141349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:23.261131 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:23.279531 (+ 18400us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:23.279566 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:14:23.279584 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:23.279986 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:23.280037 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:23.280062 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:14:23.280358 (+   296us) tablet.cc:701] Row locks acquired
0709 12:14:23.280375 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:14:23.280501 (+   126us) write_op.cc:270] Start()
0709 12:14:23.280611 (+   110us) write_op.cc:276] Timestamp: P: 1783599263280463 usec, L: 0
0709 12:14:23.280630 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:14:23.281237 (+   607us) log.cc:844] Serialized 975 byte log entry
0709 12:14:23.283341 (+  2104us) op_driver.cc:464] REPLICATION: finished
0709 12:14:23.283721 (+   380us) write_op.cc:301] APPLY: starting
0709 12:14:23.283796 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:23.283923 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:23.284014 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:23.284306 (+   292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:23.284472 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:14:23.284514 (+    42us) write_op.cc:312] APPLY: finished
0709 12:14:23.284698 (+   184us) log.cc:844] Serialized 29 byte log entry
0709 12:14:23.284874 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.284961 (+    87us) write_op.cc:454] Released schema lock
0709 12:14:23.284998 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:23.285301 (+   303us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.285330 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":467436,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":214,"apply.run_cpu_time_us":1556,"apply.run_wall_time_us":1556,"num_ops":2,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":2673,"prepare.run_wall_time_us":38918,"replication_time_us":2608}]]}
I20260709 12:14:24.328590  4365 raft_consensus.cc:3055] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:24.329154  4365 raft_consensus.cc:740] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
W20260709 12:14:24.335445  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 94545us
I20260709 12:14:24.330135  4365 consensus_queue.cc:260] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.339670  4365 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.346066  4514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0204e53e3fe3403ca1198afb918a0618" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
W20260709 12:14:24.349958  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 107564us
I20260709 12:14:24.350426  4261 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45316 (request call id 259) took 1237 ms. Trace:
I20260709 12:14:24.350813  4261 rpcz_store.cc:276] 0709 12:14:23.113250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.113441 (+   191us) service_pool.cc:224] Handling call
0709 12:14:24.350365 (+1236924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30865,"reported_tablets":1}
I20260709 12:14:24.346776  4514 raft_consensus.cc:3060] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.344602  7306 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:24.355975  4435 raft_consensus.cc:1240] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:24.356290  7306 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:24.357895  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53648.8us
I20260709 12:14:24.358659  4365 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:24.363751  7306 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:24.364899  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:24.377120  4514 raft_consensus.cc:2468] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:24.381628  4441 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:24.394776  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet d7aa6aedab9d4e14b16124d91af2f154 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:24.420833  4507 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.424111  7386 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:24.435735  4510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:24.432171  4261 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:24.448853  4406 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:24.450963  7386 raft_consensus.cc:2804] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:24.451647  7386 raft_consensus.cc:697] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:24.452634  7386 consensus_queue.cc:237] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.470052  4507 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 4.
I20260709 12:14:24.482146  4331 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:24.499040  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:24.503067  4507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:24.511094  4357 raft_consensus.cc:1240] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:24.513829  7329 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:24.514487  7329 raft_consensus.cc:697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:24.543645  4331 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:24.558627  7431 tablet_replica.cc:333] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:24.559906  7431 raft_consensus.cc:2243] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.550415  7415 raft_consensus.cc:2749] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.574034  7431 raft_consensus.cc:2272] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.565208  7329 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:24.606774  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
I20260709 12:14:24.707060  7431 ts_tablet_manager.cc:1916] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:24.741673  4407 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:24.748622  7339 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:24.754143  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 139454us
I20260709 12:14:24.886821  7431 ts_tablet_manager.cc:1929] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 12:14:24.886881  4260 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:24.896461  7431 log.cc:1199] T d7aa6aedab9d4e14b16124d91af2f154 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/d7aa6aedab9d4e14b16124d91af2f154
I20260709 12:14:24.899994  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet d7aa6aedab9d4e14b16124d91af2f154 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:24.930361  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet e4d2f3f375e94f79a0dd385679b944aa with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:53160
I20260709 12:14:24.930168  4261 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 3 to 4, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.944465  7446 tablet_replica.cc:333] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:24.945745  7446 raft_consensus.cc:2243] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.946636  7446 raft_consensus.cc:2272] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.949324  4432 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:24.951429  4357 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:24.957518  7446 ts_tablet_manager.cc:1916] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:24.963079  4438 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:24.976111  5030 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:24.978169  7189 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:24.994220  5027 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:24.997130  7428 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:24.999346  4261 catalog_manager.cc:5697] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.003223  4510 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:25.012920  7174 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.017359  7189 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:25.020403  5023 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.025739  7411 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.027377  5027 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:25.032719  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 62360.4us
I20260709 12:14:25.038733  4357 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:25.043931  7428 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:14:25.058207  7189 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:25.065835  4261 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 6 to 7, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.071192  4261 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.093315  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d27bb118c5cf4d81b9951fd5ed73bf31 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:25.097747  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f28d6bc26fc4caeac04b56caf240716 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:25.118259  4510 raft_consensus.cc:2955] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.175959  4438 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:25.176496  4506 raft_consensus.cc:1275] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:25.170073  7446 ts_tablet_manager.cc:1929] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:14:25.198715  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f28d6bc26fc4caeac04b56caf240716 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36570
I20260709 12:14:25.187454  7446 log.cc:1199] T e4d2f3f375e94f79a0dd385679b944aa P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/e4d2f3f375e94f79a0dd385679b944aa
I20260709 12:14:25.223310  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet d27bb118c5cf4d81b9951fd5ed73bf31 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:53160
I20260709 12:14:25.189451  7411 consensus_queue.cc:1048] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:25.188840  7439 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:14:25.235579  4365 raft_consensus.cc:2955] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:25.291417  7446 tablet_replica.cc:333] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:25.292745  7446 raft_consensus.cc:2243] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.305922  7446 raft_consensus.cc:2272] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.416392  7451 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:14:25.438476  7452 tablet_replica.cc:333] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:25.485412  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet e4d2f3f375e94f79a0dd385679b944aa (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
W20260709 12:14:25.597869  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 132016us
I20260709 12:14:25.609321  4506 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:25.609617  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:25.623181  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 138546us
I20260709 12:14:25.687368  7446 ts_tablet_manager.cc:1916] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:25.724704  7452 raft_consensus.cc:2243] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:25.725725  7452 raft_consensus.cc:2272] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:25.727138  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 97767.4us
W20260709 12:14:25.741541  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 129622us
W20260709 12:14:25.782460  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 293391us
I20260709 12:14:25.812453  7446 ts_tablet_manager.cc:1929] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 12:14:25.813297  7446 log.cc:1199] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/d27bb118c5cf4d81b9951fd5ed73bf31
I20260709 12:14:25.822162  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet d27bb118c5cf4d81b9951fd5ed73bf31 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:25.834386  4361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:25.835086  4361 raft_consensus.cc:606] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:25.863157  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:25.863755  4432 raft_consensus.cc:606] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:25.865355  7462 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:25.868450  4360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:25.869026  4360 raft_consensus.cc:606] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:25.870428  7452 ts_tablet_manager.cc:1916] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:25.879405  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:25.881281  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:25.882153  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:25.928752  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 75051.5us
I20260709 12:14:25.945387  7472 raft_consensus.cc:993] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:25.950212  7438 raft_consensus.cc:993] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:25.950820  7438 raft_consensus.cc:1081] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:25.952798  7472 raft_consensus.cc:1081] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:25.960738  4441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:25.961318  4441 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:25.961687  4441 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.967298  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:25.968070  4432 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:25.968520  4432 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.978724  4432 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:25.986615  4432 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:25.987685  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:25.988572  4512 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.991689  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:25.992311  4360 raft_consensus.cc:3055] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:25.992614  4360 raft_consensus.cc:740] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:25.993294  4360 consensus_queue.cc:260] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:25.994484  4360 raft_consensus.cc:3060] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.001536  4360 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:26.002966  4407 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:25.982117  4441 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:26.015777  4512 raft_consensus.cc:2468] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:26.020196  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:26.021092  4360 raft_consensus.cc:3055] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.022393  4360 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:26.021967  4441 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:26.024307  7464 raft_consensus.cc:993] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:26.024881  7411 raft_consensus.cc:1081] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:26.010658  7175 raft_consensus.cc:2804] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:26.026083  7175 raft_consensus.cc:697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:26.027099  7175 consensus_queue.cc:237] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:26.034593  4507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:26.035230  4507 raft_consensus.cc:493] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:26.035617  4507 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.046218  7452 ts_tablet_manager.cc:1929] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:14:26.046712  7452 log.cc:1199] T 1f28d6bc26fc4caeac04b56caf240716 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/1f28d6bc26fc4caeac04b56caf240716
I20260709 12:14:26.047586  4507 raft_consensus.cc:515] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:26.054317  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb5c6cd99c34c058da3556e59e8e01c" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:26.055073  4512 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.060670  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 1f28d6bc26fc4caeac04b56caf240716 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:26.069483  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:26.070192  5027 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.074266  4432 raft_consensus.cc:1240] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:26.075779  4507 leader_election.cc:290] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:26.078770  4512 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 9.
I20260709 12:14:26.091794  4406 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:26.099092  5027 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:26.101187  4479 leader_election.cc:304] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:26.104959  7467 raft_consensus.cc:2804] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.105605  7467 raft_consensus.cc:697] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:26.084328  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f130dbf22aa4fec863590cd97a47f17" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:26.108275  4435 raft_consensus.cc:3055] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:26.108587  4435 raft_consensus.cc:740] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:26.112051  4435 consensus_queue.cc:260] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:26.117879  4435 raft_consensus.cc:3060] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.120992  7463 raft_consensus.cc:2804] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.121646  7463 raft_consensus.cc:697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:26.122702  7463 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:26.095718  7421 consensus_queue.cc:1059] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:14:26.128733  4360 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:26.130136  4360 raft_consensus.cc:3060] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.148682  4360 raft_consensus.cc:2468] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 9.
W20260709 12:14:26.155094  7421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:26.106699  7467 consensus_queue.cc:237] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:26.175835  4435 raft_consensus.cc:2468] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:26.208606  4261 catalog_manager.cc:5697] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.228734  4262 catalog_manager.cc:5697] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.289915  4261 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 8 to 9, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 9 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.413081  4360 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:26.420238  7464 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:26.498073  4507 raft_consensus.cc:1275] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:26.500213  7175 consensus_queue.cc:1048] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:26.606794  4435 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:26.608214  7401 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:26.680721  4507 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:26.695804  5027 raft_consensus.cc:1275] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:26.703543  7401 consensus_queue.cc:1048] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:26.744518  4360 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:26.746424  7464 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:26.772262  4479 consensus_peers.cc:597] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9abe6120f15d41dd8f67749ea3529089. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:26.782131  4507 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:26.774789  4435 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:26.787822  7401 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:26.790661  4360 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:26.793270  7401 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:26.814890  7463 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:26.894783  7470 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:26.903657  4435 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:26.935516  4362 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:26.941804  4262 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:26.992722  4507 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:27.032011  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:27.046238  4479 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdb8329d46e44c7bbc1100c6da0c55b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:27.054546  4360 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:27.061376  7470 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:27.088136  7470 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.099679  4435 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:27.110591  7467 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:27.096400  4360 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.177897  4435 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.194875  4362 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:27.197786  4260 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.257890  7509 ts_tablet_manager.cc:933] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:27.264535  4507 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:27.264936  4435 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:27.266569  7498 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:27.271512  4330 consensus_peers.cc:597] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c0f779e13cd4398b4596cccced22d75. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:27.274848  7466 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:27.323096  7509 tablet_copy_client.cc:323] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:14:27.411253  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet 9abe6120f15d41dd8f67749ea3529089 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:14:27.412810  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet 9abe6120f15d41dd8f67749ea3529089 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-9abe6120f15d41dd8f67749ea3529089
I20260709 12:14:27.483094  4525 tablet_copy_source_session.cc:215] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:27.494204  7509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abe6120f15d41dd8f67749ea3529089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:27.578555  7515 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.618636  7520 ts_tablet_manager.cc:933] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:27.624214  4433 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:27.665444  4435 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.677335  4260 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.679344  7520 tablet_copy_client.cc:323] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:14:27.681344  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet bdb8329d46e44c7bbc1100c6da0c55b1 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:14:27.681915  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet bdb8329d46e44c7bbc1100c6da0c55b1 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-bdb8329d46e44c7bbc1100c6da0c55b1
W20260709 12:14:27.682394  4405 consensus_peers.cc:597] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9b9bc6664cb46d1b1ccf0965abab439. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:27.682883  4509 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:27.684635  7464 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:27.693979  4525 tablet_copy_source_session.cc:215] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:27.699057  7520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb8329d46e44c7bbc1100c6da0c55b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:27.711480  7464 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.725934  4509 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.744215  4359 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:27.750120  4512 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.792335  7509 tablet_copy_client.cc:806] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:27.793612  7509 tablet_copy_client.cc:670] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:27.804494  4260 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.816282  7509 tablet_copy_client.cc:538] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:27.839080  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 63343.6us
W20260709 12:14:27.844087  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 011d2125e98642bfaa9d1a5c58747e7e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 6f6e8442c230466296caa54a80810609 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:27.846876  7517 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:27.850950  7509 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:27.856434  7520 tablet_copy_client.cc:806] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:27.857170  7520 tablet_copy_client.cc:670] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:27.877719  7520 tablet_copy_client.cc:538] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:27.886122  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:27.887012  4435 raft_consensus.cc:606] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:27.916153  4512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:27.916805  4512 raft_consensus.cc:606] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:27.936522  7525 ts_tablet_manager.cc:933] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:14:27.965673  4362 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:27.996165  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:27.996821  4435 raft_consensus.cc:606] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:28.000017  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:28.002137  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:28.003440  7525 tablet_copy_client.cc:323] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:14:28.004526  7509 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:28.005366  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 7c0f779e13cd4398b4596cccced22d75 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:14:28.005650  7509 tablet_bootstrap.cc:492] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:28.006031  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 7c0f779e13cd4398b4596cccced22d75 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-7c0f779e13cd4398b4596cccced22d75
I20260709 12:14:28.006693  7509 ts_tablet_manager.cc:1403] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.015s
I20260709 12:14:28.010861  7509 raft_consensus.cc:359] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.011802  7509 raft_consensus.cc:740] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:28.012509  7509 consensus_queue.cc:260] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.014811  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:28.016124  7509 ts_tablet_manager.cc:1434] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:28.017916  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-9abe6120f15d41dd8f67749ea3529089 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:28.018395  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-9abe6120f15d41dd8f67749ea3529089 on tablet 9abe6120f15d41dd8f67749ea3529089 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:28.019502  7520 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:28.022900  4376 tablet_copy_source_session.cc:215] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:28.031817  7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0f779e13cd4398b4596cccced22d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:28.113327  7509 ts_tablet_manager.cc:933] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:28.114243  7525 tablet_copy_client.cc:806] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:28.116289  7525 tablet_copy_client.cc:670] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:28.117978  7509 tablet_copy_client.cc:323] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:28.131006  7506 raft_consensus.cc:993] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:28.131670  7524 raft_consensus.cc:1081] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:28.133416  7525 tablet_copy_client.cc:538] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:28.141969  4360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:28.142659  4360 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.143021  4360 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.150736  7525 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:28.220147  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet e9b9bc6664cb46d1b1ccf0965abab439 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:28.220836  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet e9b9bc6664cb46d1b1ccf0965abab439 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-e9b9bc6664cb46d1b1ccf0965abab439
I20260709 12:14:28.238687  5030 raft_consensus.cc:1217] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 12:14:28.246845  4360 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.259573  7470 raft_consensus.cc:993] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:28.260174  7470 raft_consensus.cc:1081] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:28.285588  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:28.287102  4435 raft_consensus.cc:3055] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:28.287417  4435 raft_consensus.cc:740] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:28.288278  4435 consensus_queue.cc:260] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.289523  4435 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.294535  4360 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:28.295770  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:28.296980  5030 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.319787  4451 tablet_copy_source_session.cc:215] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:28.321957  4433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:14:28.323909  4433 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.324311  4433 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.326166  4435 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:28.328152  7520 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:28.329172  7520 tablet_bootstrap.cc:492] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:28.329849  7520 ts_tablet_manager.cc:1403] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.311s	user 0.071s	sys 0.066s
I20260709 12:14:28.332967  7520 raft_consensus.cc:359] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.333822  7520 raft_consensus.cc:740] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:28.340294  4433 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.344329  7509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b9bc6664cb46d1b1ccf0965abab439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:28.344866  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:28.345474  5027 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.346400  4433 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:28.334491  7520 consensus_queue.cc:260] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.385607  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:28.391515  4509 raft_consensus.cc:3055] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:28.390750  5030 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 6.
I20260709 12:14:28.391857  4509 raft_consensus.cc:740] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:28.392426  7520 ts_tablet_manager.cc:1434] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:14:28.392753  4509 consensus_queue.cc:260] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.393369  4330 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:28.393940  4509 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.394863  7518 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:28.396093  7518 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:28.401654  7518 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.390187  5027 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:28.411897  4405 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:28.415247  7519 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:28.415781  7519 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:28.416663  7519 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:28.410671  4509 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:28.433590  7465 raft_consensus.cc:993] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:28.434158  7465 raft_consensus.cc:1081] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:28.436372  4359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:28.436914  4359 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:28.437243  4359 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.455271  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-bdb8329d46e44c7bbc1100c6da0c55b1 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:28.455858  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-bdb8329d46e44c7bbc1100c6da0c55b1 on tablet bdb8329d46e44c7bbc1100c6da0c55b1 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:28.446939  4359 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:28.512220  4262 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 6 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.515854  7509 tablet_copy_client.cc:806] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:28.516539  7509 tablet_copy_client.cc:670] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:28.527650  7509 tablet_copy_client.cc:538] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:28.555370  4260 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.556175  4359 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:28.563772  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:28.564384  4509 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.564807  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:28.565398  4433 raft_consensus.cc:3055] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:28.565682  4433 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:28.566666  4433 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:28.567690  4433 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:28.581429  7525 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:28.582504  7525 tablet_bootstrap.cc:492] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:28.583319  7525 ts_tablet_manager.cc:1403] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.433s	user 0.035s	sys 0.003s
I20260709 12:14:28.598835  4433 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:28.622493  5027 raft_consensus.cc:1217] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:14:28.573523  4509 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 3.
I20260709 12:14:28.652413  7525 raft_consensus.cc:359] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.653294  4332 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:28.654309  7518 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:28.654812  7518 raft_consensus.cc:697] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:28.655700  7518 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:28.653442  7525 raft_consensus.cc:740] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:28.671113  7525 consensus_queue.cc:260] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.673133  7509 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:28.691960  7525 ts_tablet_manager.cc:1434] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.000s
I20260709 12:14:28.705117  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-7c0f779e13cd4398b4596cccced22d75 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:14:28.705691  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-7c0f779e13cd4398b4596cccced22d75 on tablet 7c0f779e13cd4398b4596cccced22d75 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:28.740303  7501 raft_consensus.cc:1064] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:28.757588  7501 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:28.773844  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 84036.9us
I20260709 12:14:28.783181  7509 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:28.784363  7509 tablet_bootstrap.cc:492] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:28.785223  7509 ts_tablet_manager.cc:1403] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.112s	user 0.031s	sys 0.008s
I20260709 12:14:28.788643  7509 raft_consensus.cc:359] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.791818  4260 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 2 to 3, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.801286  7509 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:28.802222  7509 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:28.804637  7509 ts_tablet_manager.cc:1434] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:14:28.807689  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-e9b9bc6664cb46d1b1ccf0965abab439 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:28.808207  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-e9b9bc6664cb46d1b1ccf0965abab439 on tablet e9b9bc6664cb46d1b1ccf0965abab439 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:28.858357  5030 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:28.862401  7470 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:28.866112  4433 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:28.871596  7470 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:28.882491  4365 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:28.884970  7470 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:28.897831  4432 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:28.900900  5027 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:28.903995  7463 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.919584  5030 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:28.921280  7498 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.929535  7498 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.956144  7398 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:28.964919  4433 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:28.977815  5022 raft_consensus.cc:1217] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 12:14:29.081327  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 65715.4us
W20260709 12:14:29.086314  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 72563.9us
W20260709 12:14:29.127887  7532 log.cc:927] Time spent T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:29.189339  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:29.208140  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 147689us
W20260709 12:14:29.275795  7547 log.cc:927] Time spent T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:29.479115  4510 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:14:29.561976  4332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.030s
W20260709 12:14:29.562417  4332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.010s	sys 0.030s
W20260709 12:14:29.581518  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 157538us
I20260709 12:14:29.622933  4441 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:29.673228  7568 raft_consensus.cc:1064] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:29.675740  7568 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:29.684842  4481 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.006s	sys 0.009s
W20260709 12:14:29.685282  4481 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.007s	sys 0.009s
W20260709 12:14:29.685560  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 683393us
I20260709 12:14:29.723590  4509 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:29.727842  4359 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:29.743721  5030 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:29.746803  5025 raft_consensus.cc:1217] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:14:29.757357  4363 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:29.763325  4260 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.784914  5027 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:29.785756  7554 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:14:29.819727  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 47649.3us
W20260709 12:14:29.832811  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 48386.1us
I20260709 12:14:29.834240  7553 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:29.862282  7519 raft_consensus.cc:1064] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:29.864778  7519 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:29.874879  7564 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:29.890316  7548 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:14:29.895692  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 51851.3us
I20260709 12:14:29.943894  5028 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:29.952170  4360 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:29.962239  4432 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:29.996114  7557 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:14:30.010015  7562 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 12:14:30.032009  4479 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.035530  7549 raft_consensus.cc:1064] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:30.039343  7549 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.055222  7463 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:14:30.056147  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 63865us
W20260709 12:14:30.067909  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 68574us
I20260709 12:14:30.115255  7567 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:30.117654  7580 log.cc:927] Time spent T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:14:30.118280  4506 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:30.145334  7567 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.166749  4359 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.173462  4360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:30.174347  4360 raft_consensus.cc:606] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:30.178417  7506 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:30.184093  7581 log.cc:927] Time spent T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:30.256735  7560 raft_consensus.cc:993] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:30.273201  7560 raft_consensus.cc:1081] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:30.287046  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:30.287705  4432 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.288050  4432 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.294781  5028 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:30.318073  4507 consensus_queue.cc:237] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.320083  7498 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:30.402137  5027 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.420567  4433 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:30.423645  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 78692us
I20260709 12:14:30.426652  7585 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.431531  4432 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:30.433573  4432 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:30.442837  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 128641us
I20260709 12:14:30.442726  5023 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.445979  4513 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:30.462713  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:30.463577  4513 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:30.468683  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08002ecfc0 after lost signal to thread 3214
I20260709 12:14:30.467815  4506 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:30.469775  5052 debug-util.cc:398] Leaking SignalData structure 0x7b080021bf60 after lost signal to thread 4298
W20260709 12:14:30.470957  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08002cfd80 after lost signal to thread 4390
W20260709 12:14:30.472141  5052 debug-util.cc:398] Leaking SignalData structure 0x7b0800239da0 after lost signal to thread 4465
W20260709 12:14:30.472575  5052 debug-util.cc:398] Leaking SignalData structure 0x7b080037bfc0 after lost signal to thread 4481
W20260709 12:14:30.473651  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08003207a0 after lost signal to thread 4539
W20260709 12:14:30.474898  5052 debug-util.cc:398] Leaking SignalData structure 0x7b0800302cc0 after lost signal to thread 5055
I20260709 12:14:30.483538  4361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:30.484228  4361 raft_consensus.cc:606] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:30.494894  4262 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.504102  5027 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:30.489113  4513 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:30.518090  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3ddaccf4b5439b920d6b4aaeaa2e64" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:30.523972  4441 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.527410  4361 raft_consensus.cc:3055] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:30.527792  4361 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:30.521181  7498 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:30.520084  7568 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:14:30.534324  4263 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.533392  4359 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.551296  4438 raft_consensus.cc:1275] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:30.528489  4361 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:30.556252  4361 raft_consensus.cc:3060] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.561609  4506 raft_consensus.cc:1240] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Rejecting Update request from peer 6f6e8442c230466296caa54a80810609 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:30.560789  4406 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:30.568562  4438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:30.569212  4438 raft_consensus.cc:606] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:30.570569  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:30.573375  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:30.576887  7568 consensus_queue.cc:1048] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:30.581117  7518 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:14:30.590534  7562 raft_consensus.cc:993] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:30.591118  7562 raft_consensus.cc:1081] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:30.583314  7463 raft_consensus.cc:2804] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:30.591794  7463 raft_consensus.cc:697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:30.592715  7463 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:30.594947  4506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:30.595590  4506 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.595947  4506 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.596967  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:30.609926  4506 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.613281  4361 raft_consensus.cc:2468] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:30.615262  7398 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:30.612877  4251 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 14 similar messages]
I20260709 12:14:30.639632  5027 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.684780  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9abe6120f15d41dd8f67749ea3529089 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:30.685590  4513 consensus_queue.cc:237] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.686444  4261 catalog_manager.cc:5697] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.704519  5027 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:30.722683  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:30.723351  4363 raft_consensus.cc:1275] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:30.723469  4361 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.728205  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:30.729394  4506 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:30.729795  4435 raft_consensus.cc:3055] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:30.730175  4435 raft_consensus.cc:740] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:30.731115  4435 consensus_queue.cc:260] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.720611  7567 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:14:30.740935  7564 consensus_queue.cc:1048] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:30.744112  7549 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:30.751075  4251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 138219us
I20260709 12:14:30.752836  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b9bc6664cb46d1b1ccf0965abab439" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:30.753480  5027 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.734427  4435 raft_consensus.cc:3060] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.775048  7467 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.796180  5023 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.787315  4362 raft_consensus.cc:2955] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.806030  4438 raft_consensus.cc:2955] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:30.809003  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53942.4us
I20260709 12:14:30.810702  4361 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:30.818091  5027 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:30.812569  4263 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.829429  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 9abe6120f15d41dd8f67749ea3529089 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53160
I20260709 12:14:30.832424  4481 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:30.845618  7398 raft_consensus.cc:2804] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:30.846395  7398 raft_consensus.cc:697] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:30.847687  7398 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:30.856106  7306 raft_consensus.cc:993] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:30.856666  7306 raft_consensus.cc:1081] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:30.866268  4435 raft_consensus.cc:2468] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:30.869637  7605 tablet_replica.cc:333] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:30.877418  4511 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.885628  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdb8329d46e44c7bbc1100c6da0c55b1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:14:30.887275  4251 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e9b9bc6664cb46d1b1ccf0965abab439 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6b40d129d452470ba95c63b1eb11f804 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.889153  4434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:14:30.896332  5027 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.908488  4434 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.909788  4434 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:30.843611  4441 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.957518  7605 raft_consensus.cc:2243] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:30.958385  7605 raft_consensus.cc:2272] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:30.965240  4263 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.968118  4261 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.965898  4262 catalog_manager.cc:5697] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 5 to 6, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:30.967339  7605 ts_tablet_manager.cc:1916] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:30.980631  4434 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:31.013674  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:31.014444  4362 raft_consensus.cc:3055] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:31.014832  4362 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:31.017134  4362 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:31.018512  4362 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.023355  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:31.024174  4511 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.039103  4360 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:31.012989  4434 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:31.041761  7571 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:31.070549  4361 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:31.074200  4513 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:31.075891  4362 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
I20260709 12:14:31.074872  4511 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
I20260709 12:14:31.077239  4406 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:31.089711  7605 ts_tablet_manager.cc:1929] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:14:31.090296  7605 log.cc:1199] T 9abe6120f15d41dd8f67749ea3529089 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/9abe6120f15d41dd8f67749ea3529089
I20260709 12:14:31.091568  5027 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:31.094357  7571 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.094863  7571 raft_consensus.cc:697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:31.095178  7562 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:31.095755  7571 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:31.094885  7549 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:14:31.103549  4506 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:31.114177  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 9abe6120f15d41dd8f67749ea3529089 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:31.125450  7306 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:14:31.157202  7554 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.176180  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet bdb8329d46e44c7bbc1100c6da0c55b1 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:31.207429  5027 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.216818  4507 raft_consensus.cc:2955] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.218820  4262 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 7 to 8, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.277858  4434 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:31.286257  5023 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:31.317935  4262 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 7 to 8, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.289840  7564 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:14:31.340196  7568 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:31.349387  7611 tablet_replica.cc:333] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:31.350769  7611 raft_consensus.cc:2243] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.351744  7611 raft_consensus.cc:2272] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.356643  4360 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:31.364086  7564 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:31.371997  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c0f779e13cd4398b4596cccced22d75 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:31.373559  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0f779e13cd4398b4596cccced22d75 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:31.378326  7611 ts_tablet_manager.cc:1916] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:31.482018  7611 ts_tablet_manager.cc:1929] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:14:31.489979  7611 log.cc:1199] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/bdb8329d46e44c7bbc1100c6da0c55b1
I20260709 12:14:31.491716  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet bdb8329d46e44c7bbc1100c6da0c55b1 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:31.492235  7611 tablet_replica.cc:333] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:31.493798  7611 raft_consensus.cc:2243] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.494668  7611 raft_consensus.cc:2272] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.516345  7611 ts_tablet_manager.cc:1916] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:31.517750  4361 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:31.519361  7586 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:31.576247  7611 ts_tablet_manager.cc:1929] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:14:31.576854  7611 log.cc:1199] T 7c0f779e13cd4398b4596cccced22d75 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/7c0f779e13cd4398b4596cccced22d75
I20260709 12:14:31.579674  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 7c0f779e13cd4398b4596cccced22d75 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:31.607620  4506 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:31.613644  4506 consensus_queue.cc:237] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:31.612157  7562 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:14:31.630977  4441 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:31.632938  7501 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:31.635984  5023 raft_consensus.cc:1275] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:31.640331  7567 consensus_queue.cc:1048] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:31.648957  7564 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.652868  4441 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.652580  5027 raft_consensus.cc:2955] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.699854  4262 catalog_manager.cc:5697] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 5 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 5 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:31.718403  4250 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9b9bc6664cb46d1b1ccf0965abab439 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:14:31.726092  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet e9b9bc6664cb46d1b1ccf0965abab439 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53160
I20260709 12:14:31.732136  7618 tablet_replica.cc:333] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:31.737751  7618 raft_consensus.cc:2243] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:31.738576  7618 raft_consensus.cc:2272] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:31.749861  7618 ts_tablet_manager.cc:1916] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:31.834801  7618 ts_tablet_manager.cc:1929] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:14:31.835668  7618 log.cc:1199] T e9b9bc6664cb46d1b1ccf0965abab439 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/e9b9bc6664cb46d1b1ccf0965abab439
I20260709 12:14:31.837334  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet e9b9bc6664cb46d1b1ccf0965abab439 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:31.898536  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:32.035820  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:32.036422  4435 raft_consensus.cc:606] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Received request to transfer leadership to TS 6f6e8442c230466296caa54a80810609
I20260709 12:14:32.051059  4513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:32.051748  4513 raft_consensus.cc:606] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:32.058868  4435 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:32.059546  4435 raft_consensus.cc:606] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:32.063898  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:32.071069  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:32.071920  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:32.470139  7506 raft_consensus.cc:993] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:32.470731  7506 raft_consensus.cc:1081] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:32.473960  4506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:32.474599  4506 raft_consensus.cc:493] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.474942  4506 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.493465  4506 raft_consensus.cc:515] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.497530  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:32.498131  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0e2bd80ae11402a8a9e199424af5458" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:32.498824  4441 raft_consensus.cc:3055] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.499186  4441 raft_consensus.cc:740] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:32.500020  4441 consensus_queue.cc:260] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.501215  4441 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.498257  4361 raft_consensus.cc:3060] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.525887  7506 raft_consensus.cc:993] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:32.526571  7562 raft_consensus.cc:1081] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Signalling peer 6f6e8442c230466296caa54a80810609 to start an election
I20260709 12:14:32.529702  4360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3"
dest_uuid: "6f6e8442c230466296caa54a80810609"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:14:32.530324  4360 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.530689  4360 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.559551  4506 leader_election.cc:290] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:32.578940  4441 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:32.581341  7567 raft_consensus.cc:993] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:32.597398  7567 raft_consensus.cc:1081] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:32.581928  4360 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.599826  4435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:14:32.559254  4361 raft_consensus.cc:2468] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:32.600522  4435 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.601028  4435 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.602850  4481 leader_election.cc:304] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:32.604050  7568 raft_consensus.cc:2804] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.604710  7568 raft_consensus.cc:697] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:32.606042  7568 consensus_queue.cc:237] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.614275  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:32.615082  4513 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.637475  4513 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:32.639117  4331 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:32.640234  7518 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.640861  7518 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Becoming Leader. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:32.641963  7518 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.614322  4360 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:32.649785  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:32.650483  4438 raft_consensus.cc:3055] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.647027  4435 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.655761  4362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:32.656589  4362 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.650771  4438 raft_consensus.cc:740] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:32.662557  4438 consensus_queue.cc:260] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.669842  4438 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.670815  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:32.675843  4435 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:32.684078  4513 raft_consensus.cc:3055] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.684597  4513 raft_consensus.cc:740] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:32.685812  4513 consensus_queue.cc:260] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.687336  4513 raft_consensus.cc:3060] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.694263  4261 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 reported cstate change: term changed from 6 to 7, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 6f6e8442c230466296caa54a80810609 (127.3.34.193). New cstate: current_term: 7 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.667555  4362 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:32.706456  4262 catalog_manager.cc:5697] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 7, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 7 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:32.710695  4407 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:32.711709  7506 raft_consensus.cc:2804] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:32.712301  7506 raft_consensus.cc:697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:32.713229  7506 consensus_queue.cc:237] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:32.716075  4513 raft_consensus.cc:2468] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:32.694304  4438 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f6e8442c230466296caa54a80810609 in term 7.
I20260709 12:14:32.770316  4260 catalog_manager.cc:5697] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 6 to 7, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.927639  4435 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:14:33.062175  4405 consensus_peers.cc:597] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb5c6cd99c34c058da3556e59e8e01c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.071152  4513 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:33.074081  7562 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:33.077699  4362 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:33.079720  7562 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:33.097389  4362 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:33.104683  7567 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:33.116423  7562 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.204705  4434 raft_consensus.cc:1275] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:33.206607  7567 consensus_queue.cc:1048] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:33.212128  4362 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.217592  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:33.224170  4513 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:33.231178  7518 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:33.235095  4438 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:33.237684  4506 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:33.246747  7506 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:33.416116  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59610us
I20260709 12:14:33.430728  4361 raft_consensus.cc:1275] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:33.451732  7631 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:33.469515  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 227447us
W20260709 12:14:33.495576  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 60717.2us
W20260709 12:14:33.527878  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 101120us
W20260709 12:14:33.533552  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 109733us
W20260709 12:14:33.547395  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 97823.2us
W20260709 12:14:33.557313  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 154349us
W20260709 12:14:33.557539  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 108095us
I20260709 12:14:33.575671  4362 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:33.648201  7662 consensus_queue.cc:1048] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:33.669878  4260 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 8, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 9 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.692579  4361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d"
dest_uuid: "6f6e8442c230466296caa54a80810609"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:14:33.693363  4361 raft_consensus.cc:606] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:33.693010  4507 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:14:33.703926  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 98474.3us
W20260709 12:14:33.717988  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 165384us
W20260709 12:14:33.722779  4330 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d8bef78062e4451b98d19e752efb309. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.736991  4439 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:33.739585  4513 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:33.740245  4513 raft_consensus.cc:606] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:33.749904  4509 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:33.751152  7642 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:33.784637  7642 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:33.832590  7642 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.835240  4439 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:33.836004  4439 raft_consensus.cc:606] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:33.845942  7564 raft_consensus.cc:993] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:33.849179  7676 ts_tablet_manager.cc:933] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:33.850728  7564 raft_consensus.cc:1081] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:33.861794  4435 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.867409  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:14:33.868026  7668 raft_consensus.cc:993] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:33.868165  4432 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.868671  7668 raft_consensus.cc:1081] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:33.868685  4432 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.873673  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:33.875427  5023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44156
I20260709 12:14:33.875813  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:33.876117  5023 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.876544  5023 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.882164  4432 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:33.884121  5023 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:33.900000  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:33.900686  4513 raft_consensus.cc:3055] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.901047  4513 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:33.901815  4513 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:33.898793  4432 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:33.903083  4513 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.905172  4507 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:33.914796  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:33.915913  4359 raft_consensus.cc:3060] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.920547  4513 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
I20260709 12:14:33.921860  4406 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:33.922850  7562 raft_consensus.cc:2804] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:33.923394  7562 raft_consensus.cc:697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:33.924620  7676 tablet_copy_client.cc:323] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:33.924340  7562 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:33.927253  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 3eb5c6cd99c34c058da3556e59e8e01c from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:33.927874  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 3eb5c6cd99c34c058da3556e59e8e01c from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-3eb5c6cd99c34c058da3556e59e8e01c
I20260709 12:14:33.932996  4359 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 8.
I20260709 12:14:33.937952  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:33.942591  5023 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:33.942509  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:33.954706  4435 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:33.956197  4451 tablet_copy_source_session.cc:215] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:33.989073  7676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb5c6cd99c34c058da3556e59e8e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:33.956951  4359 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.944967  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:33.999418  4432 raft_consensus.cc:3055] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:33.999802  4432 raft_consensus.cc:740] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:34.000583  4432 consensus_queue.cc:260] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:34.001967  4432 raft_consensus.cc:3060] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:33.979110  7633 raft_consensus.cc:993] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:34.004168  7633 raft_consensus.cc:1081] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:33.983917  4261 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 3, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.009377  4432 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:34.010872  4997 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:34.011988  7664 raft_consensus.cc:2804] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:34.013804  5023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44146
I20260709 12:14:34.012800  7664 raft_consensus.cc:697] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:34.016577  7664 consensus_queue.cc:237] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:34.021567  4365 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:34.014493  5023 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:34.022816  5023 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.025179  4405 consensus_peers.cc:597] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10f0fcfdfbd34417af879705145ed5c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.027529  7562 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:34.029313  4359 raft_consensus.cc:2468] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:34.035655  4260 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 7 to 8, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.038805  4509 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:34.045369  7657 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:34.073011  4260 catalog_manager.cc:5697] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.111908  7676 tablet_copy_client.cc:806] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:34.112612  7676 tablet_copy_client.cc:670] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:34.112985  7668 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:34.118479  4362 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:34.122735  7676 tablet_copy_client.cc:538] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:34.128103  5023 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:34.215467  5023 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:34.238957  4260 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.241847  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:34.242486  4513 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.247320  4365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:34.247978  4365 raft_consensus.cc:3055] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:34.248255  4365 raft_consensus.cc:740] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f6e8442c230466296caa54a80810609, State: Running, Role: LEADER
I20260709 12:14:34.248934  4365 consensus_queue.cc:260] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:34.250016  4365 raft_consensus.cc:3060] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.265970  4513 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
I20260709 12:14:34.267966  4996 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:34.292565  4434 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:34.278259  7649 raft_consensus.cc:2804] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.326089  4365 raft_consensus.cc:2468] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 2.
W20260709 12:14:34.365228  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 48159.7us
I20260709 12:14:34.368094  7649 raft_consensus.cc:697] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:34.369320  7649 consensus_queue.cc:237] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:34.392710  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 116057us
W20260709 12:14:34.408712  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 95167us
I20260709 12:14:34.433327  7676 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
W20260709 12:14:34.446287  4405 consensus_peers.cc:597] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b3ddaccf4b5439b920d6b4aaeaa2e64. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:34.457841  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 51003.3us
W20260709 12:14:34.459144  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 64737.9us
W20260709 12:14:34.463353  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55616.3us
I20260709 12:14:34.473556  7700 ts_tablet_manager.cc:933] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:14:34.478207  4262 catalog_manager.cc:5697] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 1 to 2, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 2 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.490094  4365 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:34.541034  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 123094us
I20260709 12:14:34.554533  7700 tablet_copy_client.cc:323] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
I20260709 12:14:34.621929  4513 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:34.582006  4507 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:34.603245  7696 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:34.602941  4376 tablet_copy_service.cc:140] P 6f6e8442c230466296caa54a80810609: Received BeginTabletCopySession request for tablet 7d8bef78062e4451b98d19e752efb309 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:53846)
I20260709 12:14:34.657496  4376 tablet_copy_service.cc:161] P 6f6e8442c230466296caa54a80810609: Beginning new tablet copy session on tablet 7d8bef78062e4451b98d19e752efb309 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:53846: session id = 133eea4ce99644f5adbd12c985fc95cb-7d8bef78062e4451b98d19e752efb309
I20260709 12:14:34.662387  4434 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:34.704702  4365 raft_consensus.cc:1275] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:34.712061  4362 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:34.716219  7619 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:14:34.729974  4506 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:34.736001  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 155928us
I20260709 12:14:34.729851  7664 consensus_queue.cc:1048] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:14:34.735033  7668 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:34.741564  7711 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:14:34.816617  4376 tablet_copy_source_session.cc:215] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:34.832228  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 89480.3us
W20260709 12:14:34.851842  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 102477us
I20260709 12:14:34.857478  7698 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:14:34.882604  7719 ts_tablet_manager.cc:933] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:34.971184  7700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bef78062e4451b98d19e752efb309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.003647  7719 tablet_copy_client.cc:323] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:35.026798  4362 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:14:35.180716  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 96947.5us
W20260709 12:14:35.195591  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 124748us
I20260709 12:14:35.073102  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:35.228297  4507 raft_consensus.cc:1275] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:14:35.236618  4361 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:35.239089  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 10f0fcfdfbd34417af879705145ed5c6 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:35.270196  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 10f0fcfdfbd34417af879705145ed5c6 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-10f0fcfdfbd34417af879705145ed5c6
I20260709 12:14:35.230886  7689 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:14:35.299204  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 68784.3us
I20260709 12:14:35.055866  7696 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:35.341928  4432 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:35.579505  4432 raft_consensus.cc:606] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:35.361544  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45999.6us
W20260709 12:14:35.592211  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 269481us
I20260709 12:14:35.592650  7700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44146 (request call id 1009) took 1160 ms. Trace:
I20260709 12:14:35.593086  7700 rpcz_store.cc:276] 0709 12:14:34.431819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.431999 (+   180us) service_pool.cc:224] Handling call
0709 12:14:34.474106 (+ 42107us) ts_tablet_manager.cc:934] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
0709 12:14:34.941128 (+467022us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:35.549055 (+607927us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:35.549205 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:35.592029 (+ 42824us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:35.592254 (+   225us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:35.592496 (+   242us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:35.592539 (+    43us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13789,"tablet-copy.queue_time_us":40184,"thread_start_us":93921,"threads_started":2}
I20260709 12:14:35.596160  7700 tablet_copy_client.cc:806] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:35.340894  7724 consensus_queue.cc:1048] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.321s
I20260709 12:14:35.645915  7700 tablet_copy_client.cc:670] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:35.382033  4451 tablet_copy_source_session.cc:215] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:35.506093  7725 log.cc:927] Time spent T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:14:35.699437  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:35.701293  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:35.702239  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:35.704177  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 45767us
I20260709 12:14:35.821658  4509 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:35.880585  7745 raft_consensus.cc:993] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:35.882503  7702 raft_consensus.cc:1081] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:35.965657  4511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:35.966585  4511 raft_consensus.cc:493] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.967053  4511 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:35.979779  7752 ts_tablet_manager.cc:933] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:36.001981  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 212164us
I20260709 12:14:36.040880  4511 raft_consensus.cc:515] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:36.045383  4511 leader_election.cc:290] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:36.054376  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:36.055701  4441 raft_consensus.cc:3055] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:36.056167  4441 raft_consensus.cc:740] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:36.057121  4441 consensus_queue.cc:260] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:36.069600  4441 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.075290  7719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f0fcfdfbd34417af879705145ed5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.154188  7656 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:14:36.155750  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 258536us
I20260709 12:14:36.171861  4364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a5885ca40b49f9a79c3ae930090feb" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:36.155371  7656 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.172581  4364 raft_consensus.cc:3060] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:36.174314  7656 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:36.175959  7696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55498 (request call id 10) took 1922 ms. Trace:
I20260709 12:14:36.232280  7696 rpcz_store.cc:276] 0709 12:14:34.249661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.280134 (+ 30473us) service_pool.cc:224] Handling call
0709 12:14:34.330419 (+ 50285us) log.cc:844] Serialized 499 byte log entry
0709 12:14:36.172187 (+1841768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75505,"raft.queue_time_us":108898,"raft.run_cpu_time_us":1691,"raft.run_wall_time_us":1691,"spinlock_wait_cycles":666496,"thread_start_us":209153,"threads_started":2,"wal-append.queue_time_us":66721,"wal-append.run_cpu_time_us":2008,"wal-append.run_wall_time_us":1020866}
I20260709 12:14:36.201341  4441 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:14:36.215922  4359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f6e8442c230466296caa54a80810609" is_pre_election: true
W20260709 12:14:36.237193  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 67007.1us
I20260709 12:14:36.208904  4364 raft_consensus.cc:2468] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 4.
I20260709 12:14:36.243440  4481 leader_election.cc:304] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:36.246866  7656 raft_consensus.cc:2804] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:14:36.225620  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 56556.1us
I20260709 12:14:36.247473  7656 raft_consensus.cc:697] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:36.248442  7656 consensus_queue.cc:237] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:36.250258  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 51872.1us
W20260709 12:14:36.224901  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 47782.5us
I20260709 12:14:36.256166  7657 raft_consensus.cc:493] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:36.256774  7657 raft_consensus.cc:515] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:36.260437  7657 leader_election.cc:290] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:36.267913  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:36.272349  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1602309b0f64e5da65bbe212dcd8578" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:36.262032  4262 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:36.282248  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:36.287302  7700 tablet_copy_client.cc:538] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:36.279443  7752 tablet_copy_client.cc:323] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:36.296380  4406 leader_election.cc:304] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:36.318451  7719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44156 (request call id 610) took 1581 ms. Trace:
I20260709 12:14:36.343649  4481 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:36.357282  7758 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:36.366181  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:36.366842  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-3b3ddaccf4b5439b920d6b4aaeaa2e64
I20260709 12:14:36.349982  7657 raft_consensus.cc:2749] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:36.378499  7700 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:36.397644  4451 tablet_copy_source_session.cc:215] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:36.401227  7752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:36.348958  7719 rpcz_store.cc:276] 0709 12:14:34.737491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.745597 (+  8106us) service_pool.cc:224] Handling call
0709 12:14:34.883191 (+137594us) ts_tablet_manager.cc:934] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
0709 12:14:35.895555 (+1012364us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:14:36.207744 (+312189us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:36.207873 (+   129us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:14:36.317652 (+109779us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:14:36.317954 (+   302us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:36.318292 (+   338us) ts_tablet_manager.cc:989] Replica registered.
0709 12:14:36.318375 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43082,"tablet-copy.queue_time_us":133825,"thread_start_us":155087,"threads_started":2}
I20260709 12:14:36.457161  7719 tablet_copy_client.cc:806] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:36.490773  7719 tablet_copy_client.cc:670] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:36.509582  7719 tablet_copy_client.cc:538] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:36.511193  7752 tablet_copy_client.cc:806] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:36.511814  7752 tablet_copy_client.cc:670] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:36.528658  7752 tablet_copy_client.cc:538] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:36.579125  7676 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.620908  7719 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:36.662508  7676 tablet_bootstrap.cc:492] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:36.686765  4261 catalog_manager.cc:5697] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 3 to 4, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 4 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:36.719107  4441 raft_consensus.cc:1275] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:36.720762  7749 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:36.721915  7676 ts_tablet_manager.cc:1403] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 2.289s	user 0.063s	sys 0.063s
I20260709 12:14:36.727133  7752 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:36.740435  4362 raft_consensus.cc:1275] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:36.741933  7564 consensus_queue.cc:1048] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:36.729334  7676 raft_consensus.cc:359] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.770534  7676 raft_consensus.cc:740] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:36.811259  7700 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.812417  7700 tablet_bootstrap.cc:492] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:36.813241  7700 ts_tablet_manager.cc:1403] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.435s	user 0.030s	sys 0.020s
I20260709 12:14:36.823325  7676 consensus_queue.cc:260] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.834254  7676 ts_tablet_manager.cc:1434] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 12:14:36.873538  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3eb5c6cd99c34c058da3556e59e8e01c received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:36.874089  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3eb5c6cd99c34c058da3556e59e8e01c on tablet 3eb5c6cd99c34c058da3556e59e8e01c with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:36.846271  7700 raft_consensus.cc:359] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.882332  7700 raft_consensus.cc:740] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:36.883370  7700 consensus_queue.cc:260] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.889891  7700 ts_tablet_manager.cc:1434] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 12:14:36.924511  4376 tablet_copy_service.cc:342] P 6f6e8442c230466296caa54a80810609: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-7d8bef78062e4451b98d19e752efb309 received from {username='slave'} at 127.0.0.1:53846
I20260709 12:14:36.925087  4376 tablet_copy_service.cc:434] P 6f6e8442c230466296caa54a80810609: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-7d8bef78062e4451b98d19e752efb309 on tablet 7d8bef78062e4451b98d19e752efb309 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:36.955420  7719 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.956894  7719 tablet_bootstrap.cc:492] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:36.957696  7719 ts_tablet_manager.cc:1403] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.337s	user 0.033s	sys 0.001s
I20260709 12:14:36.971092  7719 raft_consensus.cc:359] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:36.972059  7719 raft_consensus.cc:740] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:36.987920  7719 consensus_queue.cc:260] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:37.004901  7719 ts_tablet_manager.cc:1434] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.006s
I20260709 12:14:37.013374  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-10f0fcfdfbd34417af879705145ed5c6 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:37.013886  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-10f0fcfdfbd34417af879705145ed5c6 on tablet 10f0fcfdfbd34417af879705145ed5c6 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:37.017221  7752 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:37.018190  7752 tablet_bootstrap.cc:492] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:37.018908  7752 ts_tablet_manager.cc:1403] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.292s	user 0.026s	sys 0.009s
I20260709 12:14:37.038159  7752 raft_consensus.cc:359] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:37.043165  7752 raft_consensus.cc:740] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:37.043984  7752 consensus_queue.cc:260] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:37.060348  7752 ts_tablet_manager.cc:1434] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:14:37.062309  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3b3ddaccf4b5439b920d6b4aaeaa2e64 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:37.062798  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-3b3ddaccf4b5439b920d6b4aaeaa2e64 on tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:37.074752  5030 raft_consensus.cc:1217] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:14:37.189262  5030 raft_consensus.cc:1217] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 12:14:37.206765  5026 raft_consensus.cc:1217] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:14:37.229061  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:37.318871  5026 raft_consensus.cc:1217] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Deduplicated request from leader. Original: 5.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 12:14:37.344609  4511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:37.345350  4511 raft_consensus.cc:606] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 LEADER]: Received request to transfer leadership to TS 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:37.346869  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:37.349359  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:37.350360  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:37.484454  7633 raft_consensus.cc:1064] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:14:37.562521  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 59429us
W20260709 12:14:37.564919  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 62114.5us
W20260709 12:14:37.572396  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 67521.8us
I20260709 12:14:37.674341  7633 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:37.714044  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 73110.6us
I20260709 12:14:37.783967  5026 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEARNER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:37.801941  4512 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:14:37.825620  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 82789.3us
I20260709 12:14:37.833820  7782 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:37.835283  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 78601.1us
I20260709 12:14:37.835660  7790 raft_consensus.cc:1064] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:37.843653  7783 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:37.845963  7790 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:37.836333  4441 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:37.876564  7798 raft_consensus.cc:1064] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
W20260709 12:14:37.915920  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 324610us
I20260709 12:14:37.921528  7696 raft_consensus.cc:1064] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:37.976449  7696 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:37.887629  7798 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:38.000941  5023 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:38.005707  7805 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:38.016422  4509 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:38.019338  7804 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:38.040788  4362 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:38.071571  7795 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:38.075824  5030 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.075749  7633 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.077721  7790 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:38.079881  5028 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.090920  4511 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.118281  7804 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:38.154263  4359 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:38.168093  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 54844.8us
I20260709 12:14:38.105590  7805 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:14:38.185384  7749 raft_consensus.cc:993] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:38.185186  7698 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:14:38.238320  7808 log.cc:927] Time spent T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:38.269855  4506 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:38.270428  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 129504us
I20260709 12:14:38.273736  4361 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:38.297055  5023 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:38.254387  7749 raft_consensus.cc:1081] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 LEADER]: Signalling peer 6b40d129d452470ba95c63b1eb11f804 to start an election
I20260709 12:14:38.297513  7800 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:14:38.364387  7798 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:38.375798  4432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
 from {username='slave'} at 127.0.0.1:37844
I20260709 12:14:38.376782  4432 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:38.377192  4432 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.382349  7800 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:38.393896  4432 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:38.385507  7696 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.409901  4435 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:38.413093  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 92382.2us
I20260709 12:14:38.420847  4432 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 10 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:38.421136  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:38.433171  4508 raft_consensus.cc:3055] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:38.420651  4260 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.433612  4508 raft_consensus.cc:740] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:38.457847  4361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f82f0bdef64f9787ddce96e1f85660" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:38.458632  4361 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:38.466473  5022 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.476019  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:38.477304  4508 consensus_queue.cc:260] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:38.481997  4508 raft_consensus.cc:3060] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:38.547315  7817 log.cc:927] Time spent T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:14:38.573714  7698 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.566813  4509 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.591580  4506 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.606973  4361 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 10.
I20260709 12:14:38.612154  4360 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.617457  4508 raft_consensus.cc:2468] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 10.
I20260709 12:14:38.623274  4365 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.629125  7698 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.633632  5026 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.634392  5023 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.643507  4406 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:38.664258  7802 raft_consensus.cc:2804] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:38.674098  7802 raft_consensus.cc:697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 10 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:38.673815  4512 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.680648  7802 consensus_queue.cc:237] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:38.731961  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 70783us
I20260709 12:14:38.734187  4261 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.742597  4509 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.770160  4361 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.876910  4433 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:38.890570  5028 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.892776  7657 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:38.893904  4512 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:38.900717  7802 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:38.903203  7696 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.912909  5022 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.929164  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10f0fcfdfbd34417af879705145ed5c6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:38.910858  4263 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.940116  4263 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 8 to 9, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:38.974880  4509 raft_consensus.cc:2955] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.008859  4261 catalog_manager.cc:5697] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 9 to 10, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 10 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.101413  4262 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 6 to 7, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.149205  4347 tablet_service.cc:1558] Processing DeleteTablet for tablet 10f0fcfdfbd34417af879705145ed5c6 with delete_type TABLET_DATA_TOMBSTONED (TS 6f6e8442c230466296caa54a80810609 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53160
I20260709 12:14:39.152689  4361 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:39.160449  4433 consensus_queue.cc:237] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:39.161129  4439 consensus_queue.cc:237] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:39.164079  7829 tablet_replica.cc:333] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:39.165268  7829 raft_consensus.cc:2243] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.166615  4512 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:39.171332  7753 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:39.172286  5022 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:39.173908  7657 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:39.177289  7829 raft_consensus.cc:2272] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.177943  4361 raft_consensus.cc:1275] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:39.177294  5028 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:39.182385  7802 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.190025  7701 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:39.195574  7829 ts_tablet_manager.cc:1916] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:39.202361  5026 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:39.218040  7696 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:39.221920  4509 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:39.225104  7793 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.249361  5022 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.254778  7800 consensus_queue.cc:1048] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:39.255285  4361 raft_consensus.cc:1275] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:39.262365  4361 raft_consensus.cc:2955] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.275913  7800 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.277374  7698 consensus_queue.cc:1048] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:39.281893  5026 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.261538  7696 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:14:39.295324  4512 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.273466  5028 raft_consensus.cc:2955] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.302119  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d8bef78062e4451b98d19e752efb309 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:39.311475  4262 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 reported cstate change: config changed from index 4 to 5, VOTER 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) evicted. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.323778  4433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
mode: GRACEFUL
new_leader_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:34820
I20260709 12:14:39.324636  4433 raft_consensus.cc:606] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Received request to transfer leadership to TS a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:39.324762  4427 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d8bef78062e4451b98d19e752efb309 with delete_type TABLET_DATA_TOMBSTONED (TS 6b40d129d452470ba95c63b1eb11f804 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:39.326509  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:39.328701  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:39.343068  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:39.370798  4262 catalog_manager.cc:5697] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: config changed from index 7 to 8, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.406657  7829 ts_tablet_manager.cc:1929] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:14:39.409065  7829 log.cc:1199] T 10f0fcfdfbd34417af879705145ed5c6 P 6f6e8442c230466296caa54a80810609: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/wals/10f0fcfdfbd34417af879705145ed5c6
W20260709 12:14:39.414287  7832 log.cc:927] Time spent T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:14:39.427619  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3eb5c6cd99c34c058da3556e59e8e01c with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:14:39.445608  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 67953.3us
I20260709 12:14:39.446530  7833 tablet_replica.cc:333] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:39.440397  4251 catalog_manager.cc:5028] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): tablet 10f0fcfdfbd34417af879705145ed5c6 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:39.450652  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:14:39.492868  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 118116us
W20260709 12:14:39.499079  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 64883.6us
I20260709 12:14:39.519362  7833 raft_consensus.cc:2243] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.520495  7833 raft_consensus.cc:2272] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:39.550832  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 50056.1us
W20260709 12:14:39.551676  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 53283.9us
W20260709 12:14:39.552862  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 89135.1us
W20260709 12:14:39.555442  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59405.8us
I20260709 12:14:39.559744  7833 ts_tablet_manager.cc:1916] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:39.586278  4361 raft_consensus.cc:2955] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 9 to 10, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:39.612161  4262 catalog_manager.cc:5697] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 9 to 10, VOTER a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) evicted. New cstate: current_term: 9 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.635236  7798 raft_consensus.cc:993] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: : Instructing follower a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:39.635800  7798 raft_consensus.cc:1081] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Signalling peer a359ff757b3a4babb1229aa08bc44a60 to start an election
I20260709 12:14:39.639950  4506 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:14:39.640745  4506 raft_consensus.cc:493] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:39.641228  4506 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.664584  4505 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36570
I20260709 12:14:39.686193  4506 raft_consensus.cc:515] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:39.691592  4361 raft_consensus.cc:1275] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:39.716799  4501 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb5c6cd99c34c058da3556e59e8e01c with delete_type TABLET_DATA_TOMBSTONED (TS a359ff757b3a4babb1229aa08bc44a60 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36570
W20260709 12:14:39.783593  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 67300.2us
I20260709 12:14:39.785122  4506 leader_election.cc:290] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:39.787808  7850 tablet_replica.cc:333] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:39.789048  7850 raft_consensus.cc:2243] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.789907  7850 raft_consensus.cc:2272] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.792287  7831 consensus_queue.cc:1048] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:39.798372  7833 ts_tablet_manager.cc:1929] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:14:39.798950  7833 log.cc:1199] T 7d8bef78062e4451b98d19e752efb309 P 6b40d129d452470ba95c63b1eb11f804: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/wals/7d8bef78062e4451b98d19e752efb309
I20260709 12:14:39.801342  4251 catalog_manager.cc:5028] TS 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): tablet 7d8bef78062e4451b98d19e752efb309 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
W20260709 12:14:39.817256  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 112642us
W20260709 12:14:39.833535  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 121427us
W20260709 12:14:39.833896  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 142601us
W20260709 12:14:39.854153  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 142298us
I20260709 12:14:39.867362  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:39.868022  5028 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.869429  7850 ts_tablet_manager.cc:1916] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:39.884004  5028 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:39.904176  4433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d27bb118c5cf4d81b9951fd5ed73bf31" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:39.905010  4433 raft_consensus.cc:3055] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.905297  4433 raft_consensus.cc:740] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:39.906175  4433 consensus_queue.cc:260] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:39.914178  4433 raft_consensus.cc:3060] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:39.919934  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 137424us
I20260709 12:14:39.920819  4479 leader_election.cc:304] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:39.939726  4433 raft_consensus.cc:2468] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:39.945026  7853 raft_consensus.cc:2804] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:39.947994  7853 raft_consensus.cc:697] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:39.949034  7853 consensus_queue.cc:237] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:40.031040  7850 ts_tablet_manager.cc:1929] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 12:14:40.031735  7850 log.cc:1199] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/3b3ddaccf4b5439b920d6b4aaeaa2e64
I20260709 12:14:40.033659  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 3b3ddaccf4b5439b920d6b4aaeaa2e64 (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:40.033988  7850 tablet_replica.cc:333] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:40.040472  7850 raft_consensus.cc:2243] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:40.041973  7850 raft_consensus.cc:2272] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:40.045169  7850 ts_tablet_manager.cc:1916] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:14:40.049602  4261 catalog_manager.cc:5697] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 7 to 8, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.110621  7850 ts_tablet_manager.cc:1929] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 12:14:40.111335  7850 log.cc:1199] T 3eb5c6cd99c34c058da3556e59e8e01c P a359ff757b3a4babb1229aa08bc44a60: Deleting WAL directory at /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/wals/3eb5c6cd99c34c058da3556e59e8e01c
I20260709 12:14:40.113354  4250 catalog_manager.cc:5028] TS a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): tablet 3eb5c6cd99c34c058da3556e59e8e01c (table test-workload [id=890fbdda236647258932aede70778cc8]) successfully deleted
I20260709 12:14:40.475462  5028 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:40.478164  7853 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:40.555158  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.561854  4432 raft_consensus.cc:1275] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:40.572608  7853 consensus_queue.cc:1048] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:40.666272  4511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:40.667002  4511 raft_consensus.cc:606] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:40.668610  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:40.670320  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:40.671100  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:40.773254  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 50702.3us
W20260709 12:14:40.776021  4331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 53195.4us
I20260709 12:14:40.873131  7856 raft_consensus.cc:993] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:40.873713  7856 raft_consensus.cc:1081] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:40.878106  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:14:40.878733  5028 raft_consensus.cc:493] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.879144  5028 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.902941  5028 raft_consensus.cc:515] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:40.911612  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:40.912385  4435 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.988564  4512 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:41.087172  5028 leader_election.cc:290] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:41.089360  4435 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 9.
I20260709 12:14:41.205341  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d2f3f375e94f79a0dd385679b944aa" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:41.215801  4433 raft_consensus.cc:1240] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Rejecting Update request from peer a359ff757b3a4babb1229aa08bc44a60 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.232712  4511 raft_consensus.cc:3055] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.233228  4511 raft_consensus.cc:740] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:41.234400  4511 consensus_queue.cc:260] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:41.235611  4511 raft_consensus.cc:3060] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.214808  4997 leader_election.cc:304] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:14:41.320092  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 53522.2us
I20260709 12:14:41.440119  7861 raft_consensus.cc:2804] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:41.440773  7861 raft_consensus.cc:697] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:41.444222  7861 consensus_queue.cc:237] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:41.465806  4362 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:41.493754  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 279052us
I20260709 12:14:41.527992  4511 raft_consensus.cc:2468] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 9.
I20260709 12:14:41.531170  7870 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:14:41.588625  4433 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:41.600907  7669 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:14:41.648969  4479 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b42d741e25d64c56a067245eb7cb14c2. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:41.651613  4330 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 68510.4us
W20260709 12:14:41.654836  4405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 57682.3us
W20260709 12:14:41.672585  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 85832.3us
I20260709 12:14:41.705947  4261 catalog_manager.cc:5697] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 8 to 9, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 9 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:41.731045  7872 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.741125  4360 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.754377  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:41.764384  4432 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.767258  4441 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:41.803695  4262 catalog_manager.cc:5697] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index -1 to 5, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:41.825452  4360 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:41.828737  4512 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:41.827080  7875 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:14:41.835373  4405 consensus_peers.cc:597] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: caaa86e05efa448b8059af6c927ceffd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:41.840445  7802 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:41.869678  7897 ts_tablet_manager.cc:933] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:41.900493  7698 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.875782  7897 tablet_copy_client.cc:323] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.195:46537
I20260709 12:14:41.906418  4525 tablet_copy_service.cc:140] P a359ff757b3a4babb1229aa08bc44a60: Received BeginTabletCopySession request for tablet b42d741e25d64c56a067245eb7cb14c2 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:57688)
I20260709 12:14:41.907099  4525 tablet_copy_service.cc:161] P a359ff757b3a4babb1229aa08bc44a60: Beginning new tablet copy session on tablet b42d741e25d64c56a067245eb7cb14c2 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:57688: session id = 133eea4ce99644f5adbd12c985fc95cb-b42d741e25d64c56a067245eb7cb14c2
I20260709 12:14:41.913467  4512 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.922910  4360 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:41.928340  4525 tablet_copy_source_session.cc:215] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:41.944811  7897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42d741e25d64c56a067245eb7cb14c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:41.946461  4441 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:41.951714  7877 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:41.954103  4363 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:41.960246  4260 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 7, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:41.983433  7897 tablet_copy_client.cc:806] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:41.987896  7897 tablet_copy_client.cc:670] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:42.001812  4508 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:42.004698  7881 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:42.007441  4506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d"
dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
mode: GRACEFUL
new_leader_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:46022
I20260709 12:14:42.008117  4506 raft_consensus.cc:606] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Received request to transfer leadership to TS 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:14:42.009469  4330 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88fc213635c44d9584958cbc80077ad1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.010973  3211 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:42.012759  4435 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Refusing update from remote peer 6f6e8442c230466296caa54a80810609: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:42.013417  3211 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:42.014961  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.016839  7883 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:42.026397  7897 tablet_copy_client.cc:538] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:42.112344  4511 raft_consensus.cc:1275] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:42.116472  7897 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:42.121014  3211 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:42.132704  7861 consensus_queue.cc:1048] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:42.200734  7881 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:42.212491  4511 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:42.217196  4432 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:42.228147  7869 raft_consensus.cc:993] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: : Instructing follower 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:42.231738  7869 raft_consensus.cc:1081] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Signalling peer 133eea4ce99644f5adbd12c985fc95cb to start an election
I20260709 12:14:42.235541  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d"
dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
 from {username='slave'} at 127.0.0.1:44136
I20260709 12:14:42.236179  5028 raft_consensus.cc:493] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:42.236660  5028 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.233716  4435 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:42.250049  4262 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 4, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 3 leader_uuid: "6f6e8442c230466296caa54a80810609" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:42.298830  5028 raft_consensus.cc:515] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:42.316258  4508 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:42.316784  4405 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45fa02f6f7e44052aa4ac9fc517789e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.321879  7698 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:42.324558  4360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f6e8442c230466296caa54a80810609"
I20260709 12:14:42.325250  4360 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.327643  3211 tablet_server.cc:179] TabletServer@127.3.34.193:0 shutting down...
I20260709 12:14:42.336427  5028 leader_election.cc:290] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:42.336609  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632d1ea17544468d8db4dfec9893bc7d" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:42.337227  4508 raft_consensus.cc:3055] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:42.337522  4508 raft_consensus.cc:740] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:42.344753  4360 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
W20260709 12:14:42.340245  4407 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:42.346933  4508 consensus_queue.cc:260] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:42.348693  4508 raft_consensus.cc:3060] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:42.350449  4997 leader_election.cc:304] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609; no voters: 
I20260709 12:14:42.351408  7877 raft_consensus.cc:2804] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:42.351904  7877 raft_consensus.cc:697] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:42.365103  4508 raft_consensus.cc:2468] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:14:42.379645  7698 raft_consensus.cc:2955] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
I20260709 12:14:42.371891  7877 consensus_queue.cc:237] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:42.427467  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 74417.1us
I20260709 12:14:42.437330  4262 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:42.441847  4407 consensus_peers.cc:597] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.437829  4512 raft_consensus.cc:2955] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } } }
W20260709 12:14:42.447096  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.447883  4407 consensus_peers.cc:597] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.452033  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.453758  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 80320.2us
I20260709 12:14:42.468001  7897 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:42.477105  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.486936  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.481456  4260 catalog_manager.cc:5697] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 2 to 3, leader changed from a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 3 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.500268  7897 tablet_bootstrap.cc:492] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:42.503659  7897 ts_tablet_manager.cc:1403] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.388s	user 0.076s	sys 0.056s
I20260709 12:14:42.502589  7918 ts_tablet_manager.cc:933] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:42.502482  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.541040  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.552161  4407 consensus_peers.cc:597] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.562307  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.567320  7897 raft_consensus.cc:359] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:42.574935  7897 raft_consensus.cc:740] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:42.575922  7897 consensus_queue.cc:260] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:42.579388  7897 ts_tablet_manager.cc:1434] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.004s
I20260709 12:14:42.569433  7920 ts_tablet_manager.cc:933] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
I20260709 12:14:42.581609  7918 tablet_copy_client.cc:323] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:42.586752  4525 tablet_copy_service.cc:342] P a359ff757b3a4babb1229aa08bc44a60: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-b42d741e25d64c56a067245eb7cb14c2 received from {username='slave'} at 127.0.0.1:57688
I20260709 12:14:42.588413  4525 tablet_copy_service.cc:434] P a359ff757b3a4babb1229aa08bc44a60: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-b42d741e25d64c56a067245eb7cb14c2 on tablet b42d741e25d64c56a067245eb7cb14c2 with peer 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:14:42.593113  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.608721  4407 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.616974  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet caaa86e05efa448b8059af6c927ceffd from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:42.617666  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet caaa86e05efa448b8059af6c927ceffd from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-caaa86e05efa448b8059af6c927ceffd
W20260709 12:14:42.621884  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.636628  4407 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.638254  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.638850  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.652287  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.655459  4407 consensus_peers.cc:597] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.662606  4451 tablet_copy_source_session.cc:215] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:42.664247  7920 tablet_copy_client.cc:323] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.193:41885
W20260709 12:14:42.685856  4407 consensus_peers.cc:597] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.698544  4407 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.741084  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.750802  4407 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.755077  7918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caaa86e05efa448b8059af6c927ceffd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:42.789852  4407 consensus_peers.cc:597] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.791615  7897 ts_tablet_manager.cc:933] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:42.792416  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.793116  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.793722  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.801316  4511 raft_consensus.cc:1275] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:42.803220  7879 consensus_queue.cc:1048] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:42.818602  4407 consensus_peers.cc:597] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.818943  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.825574  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:42.826218  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.832343  7918 tablet_copy_client.cc:806] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:42.833055  7918 tablet_copy_client.cc:670] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:42.856032  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:42.857307  3211 tablet_replica.cc:333] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.857019  7918 tablet_copy_client.cc:538] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:42.863101  3211 raft_consensus.cc:2243] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.873651  3211 raft_consensus.cc:2272] T c27395ba03b841e5969f26a9b223fe7d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:42.877055  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:42.876754  3211 tablet_replica.cc:333] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.878260  3211 raft_consensus.cc:2243] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.878813  3211 raft_consensus.cc:2272] T 3568f45f51034aec8216f626ea0759ea P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.882035  7897 tablet_copy_client.cc:323] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:42.913044  7918 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:42.924474  3211 tablet_replica.cc:333] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.932960  3211 raft_consensus.cc:2243] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.933744  3211 raft_consensus.cc:2272] T b42d741e25d64c56a067245eb7cb14c2 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.936894  3211 tablet_replica.cc:333] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.937813  3211 raft_consensus.cc:2243] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.938416  3211 raft_consensus.cc:2272] T 0204e53e3fe3403ca1198afb918a0618 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.961609  3211 tablet_replica.cc:333] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.962538  3211 raft_consensus.cc:2243] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.966445  3211 raft_consensus.cc:2272] T 3eb5c6cd99c34c058da3556e59e8e01c P 6f6e8442c230466296caa54a80810609 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:42.967259  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 45fa02f6f7e44052aa4ac9fc517789e6 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:42.967998  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 45fa02f6f7e44052aa4ac9fc517789e6 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-45fa02f6f7e44052aa4ac9fc517789e6
I20260709 12:14:42.978060  4451 tablet_copy_source_session.cc:215] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:42.996678  3211 tablet_replica.cc:333] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:42.997684  3211 raft_consensus.cc:2243] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:42.998296  3211 raft_consensus.cc:2272] T d0e2bd80ae11402a8a9e199424af5458 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.001042  3211 tablet_replica.cc:333] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.028317  7897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fa02f6f7e44052aa4ac9fc517789e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.039356  3211 raft_consensus.cc:2243] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.060233  5026 raft_consensus.cc:1217] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Deduplicated request from leader. Original: 8.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 12:14:43.079335  3211 raft_consensus.cc:2272] T 7c0f779e13cd4398b4596cccced22d75 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.088243  3211 tablet_replica.cc:333] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.128738  3211 raft_consensus.cc:2243] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.129556  3211 raft_consensus.cc:2272] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.148089  3211 tablet_replica.cc:333] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.148900  3211 raft_consensus.cc:2243] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:43.180761  3211 raft_consensus.cc:2272] T 1f28d6bc26fc4caeac04b56caf240716 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.186690  3211 tablet_replica.cc:333] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.187950  3211 raft_consensus.cc:2243] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.218556  3211 raft_consensus.cc:2272] T c4f82f0bdef64f9787ddce96e1f85660 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:43.266273  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 61640.8us
W20260709 12:14:43.266520  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 61616us
I20260709 12:14:43.321429  3211 tablet_replica.cc:333] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.322368  3211 raft_consensus.cc:2243] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.343832  3211 raft_consensus.cc:2272] T 48a5885ca40b49f9a79c3ae930090feb P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.355504  7887 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.389678  7887 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:43.412253  7887 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.412969  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.413887  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.439638  7910 raft_consensus.cc:493] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.439275  4332 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:43.483357  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 52434.3us
I20260709 12:14:43.496825  7946 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:43.511644  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 123559us
I20260709 12:14:43.514155  7946 raft_consensus.cc:493] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:43.500349  7932 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.491374  7910 raft_consensus.cc:515] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.514730  7946 raft_consensus.cc:515] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.548110  3211 tablet_replica.cc:333] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.549175  7897 tablet_copy_client.cc:806] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:43.549860  7897 tablet_copy_client.cc:670] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:43.609808  7931 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.611032  7931 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:43.551508  7932 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:43.615149  3211 raft_consensus.cc:2243] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.615252  7932 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.664299  7946 leader_election.cc:290] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.664711  7931 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.668236  7910 leader_election.cc:290] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:43.713255  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 275616us
W20260709 12:14:43.735972  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 170218us
I20260709 12:14:43.741966  7897 tablet_copy_client.cc:538] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:43.749161  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.750702  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.762526  7897 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:43.779353  7943 raft_consensus.cc:493] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.779975  7882 raft_consensus.cc:493] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.780141  7931 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.780575  7882 raft_consensus.cc:515] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.780721  7931 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:43.781939  7887 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.783483  3211 raft_consensus.cc:2272] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.780005  7943 raft_consensus.cc:515] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.788736  7943 leader_election.cc:290] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.782827  7931 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.782828  7882 leader_election.cc:290] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.797690  7951 raft_consensus.cc:493] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:43.798317  7951 raft_consensus.cc:515] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:43.806411  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.824273  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.828853  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.829893  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.830539  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd282266b4fc4ef98c399a7ea99210df" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.830838  7881 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:43.831408  7881 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.833525  7881 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.834036  7881 raft_consensus.cc:493] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.834592  7871 raft_consensus.cc:493] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.835144  7931 raft_consensus.cc:493] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.835961  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.836469  7932 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.782449  7887 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.836985  7932 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:43.838097  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549e3d5d3452435687b34025926eb9d3" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.838445  7887 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.835748  7931 raft_consensus.cc:515] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.835422  7871 raft_consensus.cc:515] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.841861  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afbdad4342642f89b3c8be7ce7da5dc" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.843729  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.850013  3211 tablet_replica.cc:333] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.851014  3211 raft_consensus.cc:2243] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.834491  7881 raft_consensus.cc:515] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.854076  7871 leader_election.cc:290] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.854406  7881 leader_election.cc:290] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.856408  7910 raft_consensus.cc:493] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.857995  7870 raft_consensus.cc:1064] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:43.802438  7918 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:43.876457  7910 raft_consensus.cc:515] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.883716  7910 leader_election.cc:290] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.897738  7951 leader_election.cc:290] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.902015  7918 tablet_bootstrap.cc:492] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:43.903157  7918 ts_tablet_manager.cc:1403] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.990s	user 0.053s	sys 0.038s
I20260709 12:14:43.840667  7931 leader_election.cc:290] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.838970  7932 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:43.840812  7887 raft_consensus.cc:493] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.925041  7887 raft_consensus.cc:515] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.928804  7870 consensus_queue.cc:237] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 3, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.855290  7871 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:43.934897  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.936156  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.939689  3211 raft_consensus.cc:2272] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.942802  3211 tablet_replica.cc:333] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:43.943293  7887 leader_election.cc:290] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.943598  3211 raft_consensus.cc:2243] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:43.944527  7871 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.946300  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.945665  4438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34886e28324e3a9e84a6ecb6b1b615" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.950469  3211 raft_consensus.cc:2272] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:43.948207  7871 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.952144  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3e66082564439be8a3b4a0292e958" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.960088  7918 raft_consensus.cc:359] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:43.961088  7918 raft_consensus.cc:740] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:43.962353  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c35d8d5d0b41aca58011ae22cd5c02" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.962666  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.962386  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a539d67362a4305b85e3c294bc7c2a8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.961762  7918 consensus_queue.cc:260] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:43.966488  7887 raft_consensus.cc:493] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 133eea4ce99644f5adbd12c985fc95cb)
I20260709 12:14:43.967095  7887 raft_consensus.cc:515] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:43.968098  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ab6cc386d54892aeefaf3825ef65ee" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.969265  7887 leader_election.cc:290] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:43.969857  7887 raft_consensus.cc:493] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:43.971314  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.981403  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.982402  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdb8329d46e44c7bbc1100c6da0c55b1" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.983417  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c050a61816f48f59f2cefc96a79621d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.984052  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb845b83c8c64fc6add1f32cc9fd1f12" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.992133  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.992383  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:43.994447  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.994874  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.996105  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c34020fa889c4752979db51ac86d3251" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:43.999519  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf6bd6bb7324271871b60ca568cc852" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.001328  7932 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:44.002081  7932 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:44.003786  4331 leader_election.cc:304] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.004190  7932 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:44.004740  7932 raft_consensus.cc:2749] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.006125  4332 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.000761  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841988974fd4cd9a66ea124b9b9b284" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.011960  5022 raft_consensus.cc:1217] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:14:44.001516  7918 ts_tablet_manager.cc:1434] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.004s
I20260709 12:14:44.014781  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:43.970350  7887 raft_consensus.cc:515] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:44.032837  7887 leader_election.cc:290] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:44.039863  4332 raft_consensus.cc:2686] T caaa86e05efa448b8059af6c927ceffd P 6f6e8442c230466296caa54a80810609: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:44.041015  4331 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.043157  5023 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:44.044158  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-caaa86e05efa448b8059af6c927ceffd received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:44.045092  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-caaa86e05efa448b8059af6c927ceffd on tablet caaa86e05efa448b8059af6c927ceffd with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:44.045723  4432 raft_consensus.cc:1275] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:44.046339  7943 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.045766  4331 leader_election.cc:304] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.048640  7932 raft_consensus.cc:2749] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:44.049044  7856 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:44.049667  4331 leader_election.cc:304] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:44.050258  4332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44200.7us
I20260709 12:14:44.051653  7870 consensus_queue.cc:1048] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:44.061664  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.054358  3211 tablet_replica.cc:333] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.066056  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.066745  3211 raft_consensus.cc:2243] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.067528  3211 raft_consensus.cc:2272] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.056463  7953 raft_consensus.cc:2749] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.059898  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b524dfc86657460e8841456102df7e40" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.060222  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e80f7c2589340f0b76dfe7449339a9d" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.081121  4332 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.083913  7953 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:44.085315  4332 leader_election.cc:304] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:44.092163  7953 raft_consensus.cc:2749] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.096789  4332 leader_election.cc:304] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:44.099455  7953 raft_consensus.cc:2749] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.100961  4332 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.102249  4332 leader_election.cc:304] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:44.101327  3211 tablet_replica.cc:333] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.107154  7953 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.106376  3211 raft_consensus.cc:2243] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.107892  7953 raft_consensus.cc:2749] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.107962  3211 raft_consensus.cc:2272] T 632d1ea17544468d8db4dfec9893bc7d P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.111897  3211 tablet_replica.cc:333] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.112762  3211 raft_consensus.cc:2243] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.113381  3211 raft_consensus.cc:2272] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.114291  4331 leader_election.cc:304] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:44.119860  4331 raft_consensus.cc:2686] T b524dfc86657460e8841456102df7e40 P 6f6e8442c230466296caa54a80810609: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:44.122488  4332 leader_election.cc:304] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:14:44.123553  4332 raft_consensus.cc:2686] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6f6e8442c230466296caa54a80810609: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:44.124372  4332 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.121785  4331 leader_election.cc:304] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60
W20260709 12:14:44.126792  4332 raft_consensus.cc:2686] T c34020fa889c4752979db51ac86d3251 P 6f6e8442c230466296caa54a80810609: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:44.130254  7870 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.135218  7953 raft_consensus.cc:2749] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.133659  4441 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.138782  3211 tablet_replica.cc:333] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.127642  4332 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:44.139689  3211 raft_consensus.cc:2243] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:44.141036  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.143253  7953 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:44.147174  4332 leader_election.cc:304] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.148803  7953 raft_consensus.cc:2706] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Received pre-election callback for term 9 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:14:44.150218  4332 leader_election.cc:304] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
W20260709 12:14:44.152443  4332 raft_consensus.cc:2686] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6f6e8442c230466296caa54a80810609: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:44.152962  3211 raft_consensus.cc:2272] T abf6bd6bb7324271871b60ca568cc852 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.157047  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66db2395fb8d472bae50ea6bda5a63f8" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:44.157860  3211 tablet_replica.cc:333] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.159744  4435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53244c88a364677a229b3af6a2c00ac" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:44.160660  4439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113336c186624ff989dd5bad91201a95" candidate_uuid: "6f6e8442c230466296caa54a80810609" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:44.171754  3211 raft_consensus.cc:2243] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.174494  7897 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:44.177027  4332 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.178743  3211 raft_consensus.cc:2272] T cd282266b4fc4ef98c399a7ea99210df P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.184496  7953 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.185930  4332 leader_election.cc:304] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.186751  7953 raft_consensus.cc:2749] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.188313  4332 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f6e8442c230466296caa54a80810609; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:44.189103  7953 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:44.189291  3211 tablet_replica.cc:333] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.191144  3211 raft_consensus.cc:2243] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.191807  3211 raft_consensus.cc:2272] T 9a539d67362a4305b85e3c294bc7c2a8 P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.197595  3211 tablet_replica.cc:333] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.199517  3211 raft_consensus.cc:2243] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.204084  3211 raft_consensus.cc:2272] T 113336c186624ff989dd5bad91201a95 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.206954  3211 tablet_replica.cc:333] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.211649  7938 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.212249  7938 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.214458  7938 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:44.199892  7897 tablet_bootstrap.cc:492] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:44.216717  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:44.217923  7897 ts_tablet_manager.cc:1403] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.456s	user 0.026s	sys 0.037s
I20260709 12:14:44.219597  4262 catalog_manager.cc:5697] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:44.223896  4997 leader_election.cc:336] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.224402  4997 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:44.226198  7945 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.227214  3211 raft_consensus.cc:2243] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.228422  3211 raft_consensus.cc:2272] T 0d85ac676e004b609f70d47ae2ac3c44 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.221182  7897 raft_consensus.cc:359] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:44.281937  7897 raft_consensus.cc:740] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:44.282439  3211 tablet_replica.cc:333] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.300220  3211 raft_consensus.cc:2243] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.302567  3211 raft_consensus.cc:2272] T d7aa6aedab9d4e14b16124d91af2f154 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.303262  7947 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.303855  7947 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.305612  3211 tablet_replica.cc:333] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.306072  7947 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:44.306457  3211 raft_consensus.cc:2243] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.316495  7940 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.317181  7940 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.320017  7940 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:44.321992  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:44.322623  5023 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:44.324201  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:44.321506  7897 consensus_queue.cc:260] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:44.343444  3211 raft_consensus.cc:2272] T 2e80f7c2589340f0b76dfe7449339a9d P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.345561  4479 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:44.349174  5028 raft_consensus.cc:2955] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.366183  3211 tablet_replica.cc:333] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.383942  7929 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.384462  7929 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.384864  7929 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:44.391523  4251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 101196us
I20260709 12:14:44.394325  3211 raft_consensus.cc:2243] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.417933  7897 ts_tablet_manager.cc:1434] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.200s	user 0.006s	sys 0.006s
W20260709 12:14:44.440649  4407 leader_election.cc:336] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.442981  4407 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:44.445019  5023 raft_consensus.cc:1217] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 12:14:44.442162  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-45fa02f6f7e44052aa4ac9fc517789e6 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:44.446087  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-45fa02f6f7e44052aa4ac9fc517789e6 on tablet 45fa02f6f7e44052aa4ac9fc517789e6 with peer 133eea4ce99644f5adbd12c985fc95cb
I20260709 12:14:44.446087  7875 raft_consensus.cc:2749] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.449661  3211 raft_consensus.cc:2272] T 0850ebb64cfc469fb421b34b4c89537e P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.453647  4479 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:34969, user_credentials={real_user=slave}} blocked reactor thread for 48825us
W20260709 12:14:44.454861  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): ChangeConfig:REMOVE_PEER RPC failed for tablet 011d2125e98642bfaa9d1a5c58747e7e: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.475971  7934 raft_consensus.cc:1064] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:44.485536  7934 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.495728  3211 tablet_replica.cc:333] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.500027  3211 raft_consensus.cc:2243] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.508984  3211 raft_consensus.cc:2272] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.528988  3211 tablet_replica.cc:333] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.531602  3211 raft_consensus.cc:2243] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.541776  3211 raft_consensus.cc:2272] T bdb8329d46e44c7bbc1100c6da0c55b1 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.527784  7929 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.553355  7929 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:44.553722  3211 tablet_replica.cc:333] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.559182  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0f779e13cd4398b4596cccced22d75" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:44.581777  3211 raft_consensus.cc:2243] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.581784  5023 raft_consensus.cc:3060] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.589273  3211 raft_consensus.cc:2272] T a4f3505d639448bc9bf52e138a226844 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.595642  5028 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:44.596370  5023 raft_consensus.cc:2468] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:44.597572  4479 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:44.597469  7843 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:44.600713  4512 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:44.601437  3211 tablet_replica.cc:333] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.602473  7843 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.602766  7969 raft_consensus.cc:2804] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:44.608422  7969 raft_consensus.cc:697] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:44.609360  7969 consensus_queue.cc:237] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:44.604809  4481 leader_election.cc:336] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.607781  3211 raft_consensus.cc:2243] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.614296  3211 raft_consensus.cc:2272] T 2c050a61816f48f59f2cefc96a79621d P 6f6e8442c230466296caa54a80810609 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.617193  3211 tablet_replica.cc:333] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.617985  3211 raft_consensus.cc:2243] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.618587  3211 raft_consensus.cc:2272] T 8afbdad4342642f89b3c8be7ce7da5dc P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.624118  4407 consensus_peers.cc:597] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:44.634099  4481 leader_election.cc:336] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.642438  3211 tablet_replica.cc:333] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.643600  3211 raft_consensus.cc:2243] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.644366  3211 raft_consensus.cc:2272] T a8f3e66082564439be8a3b4a0292e958 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.648377  3211 tablet_replica.cc:333] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.649753  3211 raft_consensus.cc:2243] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.649879  4262 catalog_manager.cc:5697] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 7 to 8, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.661496  7934 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.664517  4512 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.677245  7945 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.677954  7945 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.680418  7945 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:44.683248  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:44.683954  4432 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:44.685657  4997 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
W20260709 12:14:44.687276  4997 leader_election.cc:336] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.688476  7945 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.688966  7945 raft_consensus.cc:493] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:44.690040  7945 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.703233  3211 raft_consensus.cc:2272] T 88fc213635c44d9584958cbc80077ad1 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.706207  3211 tablet_replica.cc:333] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.713380  3211 raft_consensus.cc:2243] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.727279  3211 raft_consensus.cc:2272] T 011d2125e98642bfaa9d1a5c58747e7e P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.730481  3211 tablet_replica.cc:333] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.736547  5028 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.738587  3211 raft_consensus.cc:2243] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.739364  3211 raft_consensus.cc:2272] T 92ab6cc386d54892aeefaf3825ef65ee P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.733971  4262 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 7 to 8, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.751957  3211 tablet_replica.cc:333] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.753161  3211 raft_consensus.cc:2243] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.757249  3211 raft_consensus.cc:2272] T d90f9248ceaf4ba3937a4604adcb0295 P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.761755  3211 tablet_replica.cc:333] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.762400  3211 raft_consensus.cc:2243] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.763535  3211 raft_consensus.cc:2272] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.772327  3211 tablet_replica.cc:333] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.764189  7945 raft_consensus.cc:515] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.788486  7945 leader_election.cc:290] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:44.789659  3211 raft_consensus.cc:2243] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.790422  3211 raft_consensus.cc:2272] T f841988974fd4cd9a66ea124b9b9b284 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.770228  4432 consensus_queue.cc:237] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.792469  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f28d6bc26fc4caeac04b56caf240716" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:44.793123  4441 raft_consensus.cc:3060] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.793526  3211 tablet_replica.cc:333] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.794461  3211 raft_consensus.cc:2243] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.795142  3211 raft_consensus.cc:2272] T 549e3d5d3452435687b34025926eb9d3 P 6f6e8442c230466296caa54a80810609 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.797646  3211 tablet_replica.cc:333] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.798394  3211 raft_consensus.cc:2243] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.799065  3211 raft_consensus.cc:2272] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.801597  3211 tablet_replica.cc:333] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609: stopping tablet replica
W20260709 12:14:44.801793  4997 leader_election.cc:336] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:44.802626  3211 raft_consensus.cc:2243] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.803694  3211 raft_consensus.cc:2272] T f0eddf8c8603444b95052dfcd6ec14ca P 6f6e8442c230466296caa54a80810609 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.805183  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:44.806511  3211 tablet_replica.cc:333] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.807390  3211 raft_consensus.cc:2243] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.807986  3211 raft_consensus.cc:2272] T 66db2395fb8d472bae50ea6bda5a63f8 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.810945  4441 raft_consensus.cc:2468] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:44.811672  3211 tablet_replica.cc:333] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.812678  3211 raft_consensus.cc:2243] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.813961  3211 raft_consensus.cc:2272] T 049f37cd99a74aec952c95bcc63588b9 P 6f6e8442c230466296caa54a80810609 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.817147  3211 tablet_replica.cc:333] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.817487  5028 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:44.818104  3211 raft_consensus.cc:2243] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.819386  3211 raft_consensus.cc:2272] T 1c0ed95ce6be4de980a07c4834b46498 P 6f6e8442c230466296caa54a80810609 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.819315  7935 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:44.828630  3211 tablet_replica.cc:333] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.829566  3211 raft_consensus.cc:2243] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:44.828709  7843 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.830339  3211 raft_consensus.cc:2272] T b53244c88a364677a229b3af6a2c00ac P 6f6e8442c230466296caa54a80810609 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.833833  3211 tablet_replica.cc:333] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.834487  4512 raft_consensus.cc:1275] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:44.835990  7935 consensus_queue.cc:1048] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:44.849309  4997 leader_election.cc:304] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:44.850630  7938 raft_consensus.cc:2804] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:44.851195  7938 raft_consensus.cc:697] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:44.852105  7938 consensus_queue.cc:237] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:44.848392  4512 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.851800  5028 raft_consensus.cc:2955] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:44.834585  3211 raft_consensus.cc:2243] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.856666  3211 raft_consensus.cc:2272] T 8ace27fd51bc488ca513d42f77ae9744 P 6f6e8442c230466296caa54a80810609 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:44.857982  4329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.865381  3211 tablet_replica.cc:333] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609: stopping tablet replica
I20260709 12:14:44.866139  3211 raft_consensus.cc:2243] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:44.867285  4251 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet caaa86e05efa448b8059af6c927ceffd with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:44.870875  3211 raft_consensus.cc:2272] T 7d8bef78062e4451b98d19e752efb309 P 6f6e8442c230466296caa54a80810609 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:44.978489  4263 catalog_manager.cc:5697] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:44.983613  4407 consensus_peers.cc:597] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:44.974116  4260 catalog_manager.cc:5697] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 8 to 9, VOTER 6f6e8442c230466296caa54a80810609 (127.3.34.193) evicted. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.029364  4407 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.037999  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.040822  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.053359  4481 consensus_peers.cc:597] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.065243  7935 raft_consensus.cc:1064] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:45.067914  7935 consensus_queue.cc:237] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.090945  5028 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:14:45.091362  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.092553  7843 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:45.095362  4512 raft_consensus.cc:1275] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:14:45.098889  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.100560  7936 consensus_queue.cc:1048] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:45.116266  4407 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.122049  7875 raft_consensus.cc:2955] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:45.134261  4506 raft_consensus.cc:2955] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:45.146581  5028 raft_consensus.cc:1275] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:45.148654  7969 consensus_queue.cc:1048] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:45.164728  4407 consensus_peers.cc:597] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.166028  4407 consensus_peers.cc:597] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.189229  5028 raft_consensus.cc:2955] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:45.198768  4260 catalog_manager.cc:5697] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: config changed from index 6 to 7, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
W20260709 12:14:45.233490  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.246219  4407 consensus_peers.cc:597] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.265316  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.293671  4481 connection.cc:573] client connection to 127.3.34.193:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:14:45.294401  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.296160  4407 connection.cc:769] client connection to 127.3.34.193:41885 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:14:45.299990  4407 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.300518  4407 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.300701  4997 connection.cc:769] client connection to 127.3.34.193:41885 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:14:45.301136  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:45.301614  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.311743  7870 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.312413  7870 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.316300  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:45.317484  7870 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:45.327319  7938 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.328001  7938 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.330744  7938 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.334630  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.335391  4509 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:45.338940  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:45.339924  7938 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:45.340425  7938 raft_consensus.cc:493] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.340845  7938 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:45.347326  4481 leader_election.cc:336] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.349531  4481 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.351042  7870 raft_consensus.cc:2749] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.366969  4441 raft_consensus.cc:1275] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:14:45.373531  4997 leader_election.cc:336] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.370334  7938 raft_consensus.cc:515] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.375758  4407 consensus_peers.cc:597] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.379204  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.379769  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.381817  7939 consensus_queue.cc:1048] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:45.387176  7938 leader_election.cc:290] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:45.395795  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.397536  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.407928  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d85ac676e004b609f70d47ae2ac3c44" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:45.408597  4509 raft_consensus.cc:3060] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:45.409406  4997 leader_election.cc:336] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.409822  7920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44146 (request call id 1152) took 2945 ms. Trace:
I20260709 12:14:45.410530  7920 rpcz_store.cc:276] 0709 12:14:42.464549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.464710 (+   161us) service_pool.cc:224] Handling call
0709 12:14:42.586372 (+121662us) ts_tablet_manager.cc:934] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885)
0709 12:14:45.409684 (+2823312us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34366,"tablet-copy.queue_time_us":81706,"thread_start_us":84530,"threads_started":2}
W20260709 12:14:45.412530  4995 connection.cc:466] server connection from 127.0.0.1:44146 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44146 (request call id 1152) could send its response
W20260709 12:14:45.413971  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.441144  4509 raft_consensus.cc:2468] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:45.445789  4996 leader_election.cc:304] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.447292  7945 raft_consensus.cc:2804] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:45.447844  7945 raft_consensus.cc:697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:45.448782  7945 consensus_queue.cc:237] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.475171  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.481771  7870 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.482473  7870 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.485081  7870 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.487651  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:45.487928  4262 catalog_manager.cc:5697] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:45.491433  4481 leader_election.cc:336] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.492769  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.494625  7967 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:45.505460  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:45.511272  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.534035  4407 consensus_peers.cc:597] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.575670  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.593288  7947 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.594029  7947 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.596359  7947 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.601439  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
W20260709 12:14:45.605479  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:45.608825  4481 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.609442  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.610858  7947 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.642022  7947 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.642679  7947 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.653082  4481 leader_election.cc:336] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.668349  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:45.670071  4479 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.671414  7870 raft_consensus.cc:2749] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.675423  7843 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.676040  7843 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.678380  7843 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.684022  7947 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:45.685227  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.685907  4512 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:45.688721  4406 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:45.692255  7936 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:45.692677  7936 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.693048  7936 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:45.695118  4407 leader_election.cc:336] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.696122  7945 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.696987  7945 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.699601  7945 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:45.705291  4997 leader_election.cc:336] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.711490  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.712275  4509 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:45.714640  7843 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.715512  7843 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.717957  7843 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.719309  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.719686  4996 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.721119  7938 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:45.721489  7938 raft_consensus.cc:493] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.721836  7938 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:45.722154  4407 leader_election.cc:336] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.731563  4406 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:45.732590  7875 raft_consensus.cc:2749] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:45.711555  7936 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.730342  7938 raft_consensus.cc:515] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.748811  4407 leader_election.cc:336] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:45.750002  4997 leader_election.cc:336] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.750777  7938 leader_election.cc:290] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.751417  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7aa6aedab9d4e14b16124d91af2f154" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:45.752096  4509 raft_consensus.cc:3060] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.755146  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0850ebb64cfc469fb421b34b4c89537e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:45.755803  4512 raft_consensus.cc:3060] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:45.763998  4512 raft_consensus.cc:2468] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:45.765506  4406 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.766351  7875 raft_consensus.cc:2804] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:45.766863  7875 raft_consensus.cc:697] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:45.767699  7875 consensus_queue.cc:237] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.772483  4509 raft_consensus.cc:2468] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:45.773846  4996 leader_election.cc:304] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.775051  7938 raft_consensus.cc:2804] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:45.776358  7938 raft_consensus.cc:697] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:45.777379  7938 consensus_queue.cc:237] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.779235  7936 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.793087  4262 catalog_manager.cc:5697] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.846211  4262 catalog_manager.cc:5697] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:45.848831  7947 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.849471  7947 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.851715  7947 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:45.853354  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
W20260709 12:14:45.864142  4481 leader_election.cc:336] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.865272  4481 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.868780  7843 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.869366  7843 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.870828  7947 raft_consensus.cc:2749] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:45.875488  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:45.876962  7947 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.877588  7947 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
W20260709 12:14:45.879125  4407 leader_election.cc:336] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.879571  4407 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.880370  7875 raft_consensus.cc:2749] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:45.880438  7843 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:45.885690  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:45.879946  7947 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.896299  7967 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.896903  7967 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.900357  7967 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
W20260709 12:14:45.901230  4481 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.901721  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.902271  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:45.904709  7967 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:45.905448  7945 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.906044  7945 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.909299  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:45.910667  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:45.911378  4441 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 10.
I20260709 12:14:45.912644  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:45.908145  7945 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.919122  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:45.922109  7945 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:45.922534  7945 raft_consensus.cc:493] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.922911  7945 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:45.921185  7967 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.924721  7967 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.926010  7875 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.926170  7843 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.926617  7875 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:45.926772  7843 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:45.927738  4997 leader_election.cc:336] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.928946  7875 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.929394  7843 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:45.931087  4481 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:45.931452  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.932113  4509 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 3.
W20260709 12:14:45.932397  4481 leader_election.cc:336] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.931100  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.933903  4512 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:45.934573  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:45.937183  4406 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:14:45.938172  4407 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.938390  7870 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:45.938915  4407 leader_election.cc:336] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.939471  4407 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.940842  7843 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:45.941265  7843 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.941674  7843 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:45.942302  7875 raft_consensus.cc:2749] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:45.943964  4481 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.944592  7967 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.947690  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:45.951318  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.951411  7875 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:45.952116  7875 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:45.954180  7875 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:45.956065  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:45.957788  7870 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:45.965093  4407 leader_election.cc:336] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.965715  4407 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:45.969648  7875 raft_consensus.cc:2749] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.970145  7945 raft_consensus.cc:515] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:45.972469  7945 leader_election.cc:290] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:45.968499  7843 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:45.975814  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c0ed95ce6be4de980a07c4834b46498" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:45.976606  4441 raft_consensus.cc:3060] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:45.979306  4407 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.981549  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:45.982138  4509 raft_consensus.cc:3060] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:45.984938  4997 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.988225  4512 raft_consensus.cc:1275] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:45.991348  4509 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
W20260709 12:14:45.992503  4997 leader_election.cc:336] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:45.992683  4406 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:45.991223  7945 consensus_queue.cc:1048] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:45.993582  7875 raft_consensus.cc:2804] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:45.994125  7875 raft_consensus.cc:697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:45.995059  7875 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:46.001421  4441 raft_consensus.cc:2468] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 11.
I20260709 12:14:46.008378  7938 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.009092  7938 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.018998  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:46.020776  7843 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.022857  4509 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:46.024911  7938 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.029621  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:46.030354  4432 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:46.032863  7875 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.033430  4997 leader_election.cc:304] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.037045  7945 raft_consensus.cc:2804] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:46.037665  7945 raft_consensus.cc:697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 11 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:46.039134  7843 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.038856  7945 consensus_queue.cc:237] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.039701  7843 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.041303  4262 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.042572  4997 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.033535  7875 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.043013  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:46.045965  7938 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.048044  7938 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:46.049523  4407 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.044569  7843 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.050612  7938 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:46.049431  7967 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.051203  7938 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.051611  7938 raft_consensus.cc:493] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.051545  7967 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.052109  7938 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.052943  7875 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.047360  4509 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:46.054880  7967 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:46.057149  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:46.059675  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:46.065719  4506 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
W20260709 12:14:46.067322  4481 leader_election.cc:336] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.068082  4481 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.069314  7967 raft_consensus.cc:2749] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:46.070372  4407 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.070403  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.072623  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.074236  7875 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.075276  7843 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:46.077288  7843 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.077746  7843 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.075736  7875 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.084029  7967 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.084352  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:46.084668  7967 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:46.086524  4997 leader_election.cc:336] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.086763  7967 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:46.097126  7938 raft_consensus.cc:515] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:46.098213  4481 leader_election.cc:336] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.121316  7967 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.121904  7967 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.122776  7938 leader_election.cc:290] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.124045  7967 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:46.125542  4997 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.126045  4997 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.128113  7939 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:46.128901  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:46.129561  4512 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:46.135777  4481 leader_election.cc:336] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.147756  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:46.148488  4441 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:46.148686  4512 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:46.101881  7875 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.102265  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804" is_pre_election: true
I20260709 12:14:46.150534  4432 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:46.112989  4262 catalog_manager.cc:5697] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 10 to 11, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 11 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.152220  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011d2125e98642bfaa9d1a5c58747e7e" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:46.152838  4432 raft_consensus.cc:3060] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.168231  4432 raft_consensus.cc:2468] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 7.
I20260709 12:14:46.180169  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.191514  7967 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:46.191395  7875 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.191898  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.192060  7967 raft_consensus.cc:493] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.192523  7967 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:46.195106  4997 leader_election.cc:304] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.196090  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90f9248ceaf4ba3937a4604adcb0295" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:46.196730  4512 raft_consensus.cc:3060] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.198009  7843 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.199198  7947 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:46.199627  7947 raft_consensus.cc:493] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.199980  7947 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:46.200354  4407 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.205772  4512 raft_consensus.cc:2468] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 7.
I20260709 12:14:46.207432  4406 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.207532  7947 raft_consensus.cc:515] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.208352  7936 raft_consensus.cc:2804] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:46.214520  7997 raft_consensus.cc:2804] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:46.215193  7997 raft_consensus.cc:697] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
W20260709 12:14:46.215780  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:46.216291  7875 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.216614  7997 consensus_queue.cc:237] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:46.216344  4997 leader_election.cc:336] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.222195  7936 raft_consensus.cc:697] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:46.224042  7936 consensus_queue.cc:237] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.215134  7947 leader_election.cc:290] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:46.218086  7967 raft_consensus.cc:515] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:46.236670  4407 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.239645  7967 leader_election.cc:290] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:46.239682  7843 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.245751  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f3505d639448bc9bf52e138a226844" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:46.246356  4506 raft_consensus.cc:3060] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:46.248040  4407 consensus_peers.cc:597] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.252399  4262 catalog_manager.cc:5697] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 7 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.254215  4506 raft_consensus.cc:2468] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 6.
I20260709 12:14:46.263841  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eddf8c8603444b95052dfcd6ec14ca" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:46.276448  4441 raft_consensus.cc:3060] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:46.276345  4260 catalog_manager.cc:5697] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 7 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.284672  4406 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.285907  4441 raft_consensus.cc:2468] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 7.
I20260709 12:14:46.286726  7936 raft_consensus.cc:2804] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:46.287320  7936 raft_consensus.cc:697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:46.288187  7936 consensus_queue.cc:237] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.291219  7998 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.291864  7998 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.300153  7998 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.308808  4432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc38aad677b4e24b4c61a7d79c8e8e3" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6b40d129d452470ba95c63b1eb11f804"
I20260709 12:14:46.309499  4432 raft_consensus.cc:3060] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:46.312366  3211 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4387)
I20260709 12:14:46.320727  4481 leader_election.cc:304] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.323248  7999 raft_consensus.cc:2804] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:46.324237  7999 raft_consensus.cc:697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:46.325199  7999 consensus_queue.cc:237] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.334132  4506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:46.349435  4506 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
W20260709 12:14:46.344937  4481 leader_election.cc:336] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.348392  8000 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
W20260709 12:14:46.351055  4481 leader_election.cc:336] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.350946  8000 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.354574  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:46.355327  5023 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 4.
I20260709 12:14:46.357191  4405 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 
I20260709 12:14:46.358187  7935 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:46.358615  7935 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.359011  7935 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.365648  4996 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:14:46.366155  4407 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.367065  7938 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:46.367539  7938 raft_consensus.cc:493] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.367937  7938 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.331249  4432 raft_consensus.cc:2468] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:46.334589  7998 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.376475  7998 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.375801  4506 raft_consensus.cc:1275] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:46.380750  7875 consensus_queue.cc:1048] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:46.367084  8000 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:46.386873  7998 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.387359  7938 raft_consensus.cc:515] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.396746  4481 leader_election.cc:304] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.398759  7967 raft_consensus.cc:2804] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:46.398826  4997 leader_election.cc:336] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.399430  7967 raft_consensus.cc:697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:46.400312  7967 consensus_queue.cc:237] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:46.375752  7935 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:46.408699  4407 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:46.412978  4405 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): Couldn't send request to peer 133eea4ce99644f5adbd12c985fc95cb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88fc213635c44d9584958cbc80077ad1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.413328  4260 catalog_manager.cc:5697] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 5 to 6, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 6 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.417997  4512 raft_consensus.cc:1275] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:46.418576  7938 leader_election.cc:290] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.418793  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:46.419503  4508 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 3.
I20260709 12:14:46.419595  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049f37cd99a74aec952c95bcc63588b9" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:46.420202  4513 raft_consensus.cc:3060] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:46.434156  4511 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:14:46.437508  7875 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:46.448510  4513 raft_consensus.cc:2468] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
I20260709 12:14:46.460855  7938 consensus_queue.cc:1048] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:46.464231  4996 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.465941  7997 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:46.466379  7997 raft_consensus.cc:493] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f6e8442c230466296caa54a80810609)
I20260709 12:14:46.466765  7997 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.478199  7997 raft_consensus.cc:515] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.482115  4996 leader_election.cc:304] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.483062  7938 raft_consensus.cc:2804] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:46.483592  7938 raft_consensus.cc:697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:46.484534  7938 consensus_queue.cc:237] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.498824  7997 leader_election.cc:290] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:46.505244  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bef78062e4451b98d19e752efb309" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:46.505937  4512 raft_consensus.cc:3060] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:46.522907  4512 raft_consensus.cc:2468] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:46.527832  4996 leader_election.cc:304] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:46.528729  7997 raft_consensus.cc:2804] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:46.529480  7997 raft_consensus.cc:697] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:46.530558  7935 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Requested vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:46.531103  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ace27fd51bc488ca513d42f77ae9744" candidate_uuid: "6b40d129d452470ba95c63b1eb11f804" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:46.531760  5023 raft_consensus.cc:3060] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:46.546799  5023 raft_consensus.cc:2468] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b40d129d452470ba95c63b1eb11f804 in term 5.
I20260709 12:14:46.552173  4405 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804; no voters: 6f6e8442c230466296caa54a80810609
I20260709 12:14:46.556178  4432 raft_consensus.cc:1275] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 11 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:46.569974  4260 catalog_manager.cc:5697] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 6 to 7, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 7 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.530347  7997 consensus_queue.cc:237] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:46.567121  7936 raft_consensus.cc:2804] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:14:46.580855  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.605355  7936 raft_consensus.cc:697] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Becoming Leader. State: Replica: 6b40d129d452470ba95c63b1eb11f804, State: Running, Role: LEADER
I20260709 12:14:46.628304  7936 consensus_queue.cc:237] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:46.637259  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 57780.5us
I20260709 12:14:46.613859  8015 consensus_queue.cc:1048] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:14:46.665933  4260 catalog_manager.cc:5697] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 7 to 8, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 8 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:46.668334  4407 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.682171  4508 raft_consensus.cc:1275] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:46.683962  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:46.688824  8011 consensus_queue.cc:1048] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:14:46.705266  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 104375us
W20260709 12:14:46.722074  4997 leader_election.cc:336] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:46.722941  4997 leader_election.cc:336] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:46.723781  4997 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:46.724587  4997 leader_election.cc:336] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:46.746268  4260 catalog_manager.cc:5697] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: term changed from 4 to 5, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.759625  4506 raft_consensus.cc:1275] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:46.761288  4407 consensus_peers.cc:597] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.762080  7936 consensus_queue.cc:1048] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:14:46.775045  4407 consensus_peers.cc:597] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.783427  4439 raft_consensus.cc:1275] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:46.785126  7999 consensus_queue.cc:1048] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:46.810446  8026 ts_tablet_manager.cc:933] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Initiating tablet copy from peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:46.817363  4439 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:46.826308  8026 tablet_copy_client.cc:323] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Beginning tablet copy session from remote peer at address 127.3.34.194:33573
I20260709 12:14:46.829668  4508 raft_consensus.cc:1275] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:14:46.833631  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.834849  7939 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:46.836126  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.887178  8021 consensus_queue.cc:1048] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:46.896698  4451 tablet_copy_service.cc:140] P 6b40d129d452470ba95c63b1eb11f804: Received BeginTabletCopySession request for tablet 88fc213635c44d9584958cbc80077ad1 from peer 133eea4ce99644f5adbd12c985fc95cb ({username='slave'} at 127.0.0.1:55510)
I20260709 12:14:46.897269  4451 tablet_copy_service.cc:161] P 6b40d129d452470ba95c63b1eb11f804: Beginning new tablet copy session on tablet 88fc213635c44d9584958cbc80077ad1 from peer 133eea4ce99644f5adbd12c985fc95cb at {username='slave'} at 127.0.0.1:55510: session id = 133eea4ce99644f5adbd12c985fc95cb-88fc213635c44d9584958cbc80077ad1
W20260709 12:14:46.897505  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.915740  4451 tablet_copy_source_session.cc:215] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:46.922251  4262 catalog_manager.cc:5697] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 5 to 6, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.924435  4262 catalog_manager.cc:5697] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 3 to 4, leader changed from 6f6e8442c230466296caa54a80810609 (127.3.34.193) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 4 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:46.934317  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.937844  8026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88fc213635c44d9584958cbc80077ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.952490  4441 raft_consensus.cc:1275] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:46.968223  7967 consensus_queue.cc:1048] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:47.017553  8026 tablet_copy_client.cc:806] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:47.018193  8026 tablet_copy_client.cc:670] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:47.034034  5023 raft_consensus.cc:1275] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:47.035591  7843 consensus_queue.cc:1048] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:47.054576  4997 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.067662  4508 raft_consensus.cc:1275] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:47.077806  7998 consensus_queue.cc:1048] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:14:47.097370  8026 tablet_copy_client.cc:538] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:47.103281  4407 consensus_peers.cc:597] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:47.107457  4997 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.142925  4506 raft_consensus.cc:1275] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:47.146368  7997 consensus_queue.cc:1048] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:47.165534  8026 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap starting.
I20260709 12:14:47.242689  8026 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:47.243896  8026 tablet_bootstrap.cc:492] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Bootstrap complete.
I20260709 12:14:47.244735  8026 ts_tablet_manager.cc:1403] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.016s
I20260709 12:14:47.248198  8026 raft_consensus.cc:359] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:47.249243  8026 raft_consensus.cc:740] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Initialized, Role: LEARNER
I20260709 12:14:47.250056  8026 consensus_queue.cc:260] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: NON_VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: true } }
I20260709 12:14:47.252746  8026 ts_tablet_manager.cc:1434] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:14:47.268375  4451 tablet_copy_service.cc:342] P 6b40d129d452470ba95c63b1eb11f804: Request end of tablet copy session 133eea4ce99644f5adbd12c985fc95cb-88fc213635c44d9584958cbc80077ad1 received from {username='slave'} at 127.0.0.1:55510
I20260709 12:14:47.268822  4451 tablet_copy_service.cc:434] P 6b40d129d452470ba95c63b1eb11f804: ending tablet copy session 133eea4ce99644f5adbd12c985fc95cb-88fc213635c44d9584958cbc80077ad1 on tablet 88fc213635c44d9584958cbc80077ad1 with peer 133eea4ce99644f5adbd12c985fc95cb
W20260709 12:14:47.312857  3211 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:47.334395  4407 consensus_peers.cc:597] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:47.347558  5028 raft_consensus.cc:1217] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Deduplicated request from leader. Original: 3.4->[4.5-4.5]   Dedup: 4.5->[]
W20260709 12:14:47.351332  4997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111) [suppressed 379 similar messages]
W20260709 12:14:47.386976  4407 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.407053  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.480669  4481 consensus_peers.cc:597] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:47.521687  4407 consensus_peers.cc:597] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.603952  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.607270  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.620546  4407 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.641451  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.652781  4407 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.659216  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.667877  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:47.698024  4407 consensus_peers.cc:597] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.700331  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.735791  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.744309  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.745249  4407 consensus_peers.cc:597] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:47.763504  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:47.788944  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:47.833361  7936 raft_consensus.cc:1064] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: attempting to promote NON_VOTER 133eea4ce99644f5adbd12c985fc95cb to VOTER
I20260709 12:14:47.836750  7936 consensus_queue.cc:237] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:47.841532  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:47.897117  4508 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:47.918836  5023 raft_consensus.cc:1275] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEARNER]: Refusing update from remote peer 6b40d129d452470ba95c63b1eb11f804: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:47.936976  7936 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:47.991750  7935 consensus_queue.cc:1048] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:14:48.008435  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.009356  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.010070  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.086783  4407 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:48.097050  4407 consensus_peers.cc:597] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.097877  4407 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.115692  4407 consensus_peers.cc:597] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:48.146960  8041 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:48.157281  4508 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:48.254247  5028 raft_consensus.cc:2955] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } } }
I20260709 12:14:48.274698  4263 catalog_manager.cc:5697] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 reported cstate change: config changed from index 4 to 6, 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6b40d129d452470ba95c63b1eb11f804" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:48.313612  3211 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:48.315778  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.372036  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.384843  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.425491  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.448587  4997 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.599227  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.727389  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:48.863742  4997 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:48.907616  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 55340.2us
W20260709 12:14:48.980965  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.003969  4407 consensus_peers.cc:597] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.084837  4407 consensus_peers.cc:597] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.186384  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.314177  3211 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:49.388844  4407 consensus_peers.cc:597] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.420773  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.430933  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.442195  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:49.755410  4407 consensus_peers.cc:597] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.768980  4481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44725.5us
W20260709 12:14:49.790292  4997 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.808909  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:49.824879  4997 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:49.887229  4407 consensus_peers.cc:597] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:49.887814  4407 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.034344  4407 consensus_peers.cc:597] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.058204  4407 consensus_peers.cc:597] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.070070  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.092393  4407 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.134460  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.156944  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:50.157502  4407 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.207294  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.213878  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.218258  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.281214  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.297852  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.307806  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.314774  3211 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:50.323489  4407 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:50.327266  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.365907  4481 consensus_peers.cc:597] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:50.373906  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.394662  4407 consensus_peers.cc:597] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.406473  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:50.502615  4996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 54193.8us
W20260709 12:14:50.503829  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:33573, user_credentials={real_user=slave}} blocked reactor thread for 44152.9us
W20260709 12:14:50.529421  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.807749  4997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 55894.3us
W20260709 12:14:50.857117  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.858353  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.858830  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.865149  4407 consensus_peers.cc:597] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.867636  4406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:46537, user_credentials={real_user=slave}} blocked reactor thread for 53066.1us
W20260709 12:14:50.924492  4407 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.924932  4407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41885, user_credentials={real_user=slave}} blocked reactor thread for 59186.8us
W20260709 12:14:50.937541  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:50.939852  4407 consensus_peers.cc:597] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.109315  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.187134  4997 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.265779  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.310576  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:51.315284  3211 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:51.357728  4997 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.598037  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.607610  4407 consensus_peers.cc:597] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.651134  4407 consensus_peers.cc:597] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.684034  4407 consensus_peers.cc:597] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.776614  4536 debug-util.cc:398] Leaking SignalData structure 0x7b08002850e0 after lost signal to thread 3214
W20260709 12:14:51.778060  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800285060 after lost signal to thread 4298
W20260709 12:14:51.814937  4536 debug-util.cc:398] Leaking SignalData structure 0x7b0800268c80 after lost signal to thread 4465
W20260709 12:14:51.821842  4536 debug-util.cc:398] Leaking SignalData structure 0x7b080017ee00 after lost signal to thread 4539
W20260709 12:14:51.819116  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.823376  4536 debug-util.cc:398] Leaking SignalData structure 0x7b080032c740 after lost signal to thread 5055
W20260709 12:14:51.870042  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:51.961105  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.106185  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:52.133982  4997 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.235262  4407 consensus_peers.cc:597] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.289196  4997 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.303843  4407 consensus_peers.cc:597] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:52.315838  3211 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 4387)
W20260709 12:14:52.379558  4407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 12:14:52.504596  4407 consensus_peers.cc:597] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.543936  4407 consensus_peers.cc:597] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:52.549284  3211 tablet_server.cc:196] TabletServer@127.3.34.193:0 shutdown complete.
W20260709 12:14:52.575143  4407 consensus_peers.cc:597] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.608925  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.633280  4407 consensus_peers.cc:597] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.675841  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.740777  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.772270  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.814160  4407 consensus_peers.cc:597] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:52.861377  3211 tablet_server.cc:179] TabletServer@127.3.34.194:0 shutting down...
W20260709 12:14:52.871259  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.872437  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.878189  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.897382  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.899294  4407 consensus_peers.cc:597] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:52.909929  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.910431  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.912278  4997 consensus_peers.cc:597] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.912992  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.913545  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.918397  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.923146  4997 consensus_peers.cc:597] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.924996  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.927207  4481 consensus_peers.cc:597] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.941581  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.942166  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.954267  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:52.991446  4407 consensus_peers.cc:597] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.002909  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.016775  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.035528  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.037717  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.044348  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.081015  4481 consensus_peers.cc:597] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.085796  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:53.086697  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.091382  3211 tablet_replica.cc:333] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.092475  3211 raft_consensus.cc:2243] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.093415  3211 raft_consensus.cc:2272] T b42d741e25d64c56a067245eb7cb14c2 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.108361  3211 tablet_replica.cc:333] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.111423  3211 raft_consensus.cc:2243] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.115694  3211 raft_consensus.cc:2272] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.130409  3211 tablet_replica.cc:333] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.131417  3211 raft_consensus.cc:2243] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:53.132093  4481 consensus_peers.cc:597] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.133481  4407 consensus_peers.cc:597] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:53.134666  3211 raft_consensus.cc:2272] T 1f28d6bc26fc4caeac04b56caf240716 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.137609  3211 tablet_replica.cc:333] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.138463  3211 raft_consensus.cc:2243] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.142688  3211 raft_consensus.cc:2272] T 3eb5c6cd99c34c058da3556e59e8e01c P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.145676  3211 tablet_replica.cc:333] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.155329  3211 raft_consensus.cc:2243] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.156018  3211 raft_consensus.cc:2272] T d0e2bd80ae11402a8a9e199424af5458 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.159075  3211 tablet_replica.cc:333] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.159941  3211 raft_consensus.cc:2243] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.160995  3211 raft_consensus.cc:2272] T 0204e53e3fe3403ca1198afb918a0618 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.163672  3211 tablet_replica.cc:333] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.164435  3211 raft_consensus.cc:2243] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.165179  3211 raft_consensus.cc:2272] T 3568f45f51034aec8216f626ea0759ea P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.168493  3211 tablet_replica.cc:333] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.169385  3211 raft_consensus.cc:2243] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.170488  3211 raft_consensus.cc:2272] T c4f82f0bdef64f9787ddce96e1f85660 P 6b40d129d452470ba95c63b1eb11f804 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.173345  3211 tablet_replica.cc:333] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.174139  3211 raft_consensus.cc:2243] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.174775  3211 raft_consensus.cc:2272] T 48a5885ca40b49f9a79c3ae930090feb P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.177753  3211 tablet_replica.cc:333] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.178532  3211 raft_consensus.cc:2243] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.179589  3211 raft_consensus.cc:2272] T caaa86e05efa448b8059af6c927ceffd P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.182403  3211 tablet_replica.cc:333] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.183334  3211 raft_consensus.cc:2243] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.184051  3211 raft_consensus.cc:2272] T e9b9bc6664cb46d1b1ccf0965abab439 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.187063  3211 tablet_replica.cc:333] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.189687  3211 raft_consensus.cc:2243] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.190649  3211 raft_consensus.cc:2272] T f4c35d8d5d0b41aca58011ae22cd5c02 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.194401  3211 tablet_replica.cc:333] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.195308  3211 raft_consensus.cc:2243] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.196033  3211 raft_consensus.cc:2272] T cb845b83c8c64fc6add1f32cc9fd1f12 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.199246  3211 tablet_replica.cc:333] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.200131  3211 raft_consensus.cc:2243] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.200961  3211 raft_consensus.cc:2272] T a003a2ac88974139bde682ffd3dea64c P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.203255  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:53.203796  3211 tablet_replica.cc:333] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.206923  3211 raft_consensus.cc:2243] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:53.205044  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.209497  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:53.212113  3211 raft_consensus.cc:2272] T abf6bd6bb7324271871b60ca568cc852 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.216809  4407 consensus_peers.cc:597] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:53.217639  3211 tablet_replica.cc:333] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.218508  3211 raft_consensus.cc:2243] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:53.212656  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:53.226476  3211 raft_consensus.cc:2272] T cd282266b4fc4ef98c399a7ea99210df P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.229349  3211 tablet_replica.cc:333] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.230252  3211 raft_consensus.cc:2243] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.230964  3211 raft_consensus.cc:2272] T 113336c186624ff989dd5bad91201a95 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.234058  3211 tablet_replica.cc:333] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.234947  3211 raft_consensus.cc:2243] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.249719  3211 raft_consensus.cc:2272] T 9a539d67362a4305b85e3c294bc7c2a8 P 6b40d129d452470ba95c63b1eb11f804 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.250463  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.257473  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:53.263411  3211 tablet_replica.cc:333] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
W20260709 12:14:53.270419  4481 consensus_peers.cc:597] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.271582  3211 raft_consensus.cc:2243] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Raft consensus shutting down.
W20260709 12:14:53.275041  4481 consensus_peers.cc:597] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.282335  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.283542  3211 raft_consensus.cc:2272] T c34020fa889c4752979db51ac86d3251 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.293293  4481 consensus_peers.cc:597] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:53.294250  3211 tablet_replica.cc:333] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.295300  3211 raft_consensus.cc:2243] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.297189  3211 raft_consensus.cc:2272] T 0850ebb64cfc469fb421b34b4c89537e P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.300136  3211 tablet_replica.cc:333] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.300952  3211 raft_consensus.cc:2243] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:53.308427  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.301755  3211 raft_consensus.cc:2272] T e4d2f3f375e94f79a0dd385679b944aa P 6b40d129d452470ba95c63b1eb11f804 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.316668  3211 tablet_replica.cc:333] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.317513  3211 raft_consensus.cc:2243] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.318797  3211 raft_consensus.cc:2272] T 10f0fcfdfbd34417af879705145ed5c6 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.321830  3211 tablet_replica.cc:333] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.322795  3211 raft_consensus.cc:2243] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.324070  3211 raft_consensus.cc:2272] T a4f3505d639448bc9bf52e138a226844 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.344966  3211 tablet_replica.cc:333] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.353075  3211 raft_consensus.cc:2243] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.353845  3211 raft_consensus.cc:2272] T 19356d2adb334f6fa9ec07c452d14046 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.356382  4481 consensus_peers.cc:597] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.356887  3211 tablet_replica.cc:333] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.357800  3211 raft_consensus.cc:2243] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.358444  3211 raft_consensus.cc:2272] T c1602309b0f64e5da65bbe212dcd8578 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.372629  3211 tablet_replica.cc:333] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.373545  3211 raft_consensus.cc:2243] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.375305  3211 raft_consensus.cc:2272] T c6942a9e429240fcb7987e82e7a08f52 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.380020  4481 consensus_peers.cc:597] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.388993  3211 tablet_replica.cc:333] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.390035  3211 raft_consensus.cc:2243] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.390753  3211 raft_consensus.cc:2272] T d27bb118c5cf4d81b9951fd5ed73bf31 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.393777  3211 tablet_replica.cc:333] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.394613  3211 raft_consensus.cc:2243] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.409698  3211 raft_consensus.cc:2272] T 45fa02f6f7e44052aa4ac9fc517789e6 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.412788  3211 tablet_replica.cc:333] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.413725  3211 raft_consensus.cc:2243] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.414443  3211 raft_consensus.cc:2272] T a8f3e66082564439be8a3b4a0292e958 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.417404  3211 tablet_replica.cc:333] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.439077  3211 raft_consensus.cc:2243] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.440764  3211 raft_consensus.cc:2272] T 88fc213635c44d9584958cbc80077ad1 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.443773  3211 tablet_replica.cc:333] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.444607  3211 raft_consensus.cc:2243] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.445691  3211 raft_consensus.cc:2272] T 9abe6120f15d41dd8f67749ea3529089 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.448405  3211 tablet_replica.cc:333] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.449203  3211 raft_consensus.cc:2243] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.449766  3211 raft_consensus.cc:2272] T 414c481bb7ad485898e5ed66d8a38344 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.452525  3211 tablet_replica.cc:333] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.453392  3211 raft_consensus.cc:2243] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.454066  3211 raft_consensus.cc:2272] T 011d2125e98642bfaa9d1a5c58747e7e P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.466202  4997 consensus_peers.cc:597] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.475404  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.467765  3211 tablet_replica.cc:333] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.481994  3211 raft_consensus.cc:2243] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.483398  3211 raft_consensus.cc:2272] T 92ab6cc386d54892aeefaf3825ef65ee P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.486686  3211 tablet_replica.cc:333] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.487654  3211 raft_consensus.cc:2243] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.488929  3211 raft_consensus.cc:2272] T 649a2c7d074941a39496be2ed5768f58 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.495630  3211 tablet_replica.cc:333] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.496618  3211 raft_consensus.cc:2243] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.497354  3211 raft_consensus.cc:2272] T a04eae5aed3946b19b6d1c1b40af70ca P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.512810  3211 tablet_replica.cc:333] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.513819  3211 raft_consensus.cc:2243] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.514550  3211 raft_consensus.cc:2272] T 1c0ed95ce6be4de980a07c4834b46498 P 6b40d129d452470ba95c63b1eb11f804 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.517757  3211 tablet_replica.cc:333] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.518965  3211 raft_consensus.cc:2243] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.520380  3211 raft_consensus.cc:2272] T d90f9248ceaf4ba3937a4604adcb0295 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.527094  3211 tablet_replica.cc:333] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.527961  3211 raft_consensus.cc:2243] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.528688  3211 raft_consensus.cc:2272] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.531792  3211 tablet_replica.cc:333] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.532687  3211 raft_consensus.cc:2243] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.534000  3211 raft_consensus.cc:2272] T 549e3d5d3452435687b34025926eb9d3 P 6b40d129d452470ba95c63b1eb11f804 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.536906  3211 tablet_replica.cc:333] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.537655  3211 raft_consensus.cc:2243] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.538347  3211 raft_consensus.cc:2272] T f0eddf8c8603444b95052dfcd6ec14ca P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.553728  3211 tablet_replica.cc:333] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.554524  3211 raft_consensus.cc:2243] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.555218  3211 raft_consensus.cc:2272] T 5d34886e28324e3a9e84a6ecb6b1b615 P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.571656  3211 tablet_replica.cc:333] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.572491  3211 raft_consensus.cc:2243] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.573146  3211 raft_consensus.cc:2272] T 6f130dbf22aa4fec863590cd97a47f17 P 6b40d129d452470ba95c63b1eb11f804 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.576133  3211 tablet_replica.cc:333] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.576896  3211 raft_consensus.cc:2243] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.578049  3211 raft_consensus.cc:2272] T 66db2395fb8d472bae50ea6bda5a63f8 P 6b40d129d452470ba95c63b1eb11f804 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.591933  3211 tablet_replica.cc:333] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.592765  3211 raft_consensus.cc:2243] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.607892  3211 raft_consensus.cc:2272] T b53244c88a364677a229b3af6a2c00ac P 6b40d129d452470ba95c63b1eb11f804 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.610826  3211 tablet_replica.cc:333] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804: stopping tablet replica
I20260709 12:14:53.611613  3211 raft_consensus.cc:2243] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.613306  3211 raft_consensus.cc:2272] T 8ace27fd51bc488ca513d42f77ae9744 P 6b40d129d452470ba95c63b1eb11f804 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.616283  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.696852  4997 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.745085  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.767907  4997 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:53.845924  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:53.986771  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.188347  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.249341  8057 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.250087  8057 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.252446  8057 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:54.259333  4997 leader_election.cc:336] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.260149  4997 leader_election.cc:336] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.260645  4997 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.262003  8057 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:54.287338  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.289052  8082 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.289711  8082 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.291911  8082 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:54.311939  4481 leader_election.cc:336] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.312747  4481 leader_election.cc:336] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.315652  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.327457  8057 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.326226  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.328166  8057 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.331208  8082 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.332048  8082 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.332172  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:54.332598  8082 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.333745  4512 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 8.
I20260709 12:14:54.338364  8082 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.339035  8057 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:54.340343  4996 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:54.341598  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.342320  5030 raft_consensus.cc:2468] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
W20260709 12:14:54.344611  4997 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.345562  4479 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:54.346058  8042 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.346572  8042 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.347004  8042 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.347493  8083 raft_consensus.cc:2804] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.347944  8083 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.348304  8083 raft_consensus.cc:3060] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:54.348840  4481 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.354698  8042 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.357743  8083 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.359345  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:54.360165  4512 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 133eea4ce99644f5adbd12c985fc95cb in current term 9: Already voted for candidate a359ff757b3a4babb1229aa08bc44a60 in this term.
I20260709 12:14:54.361315  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caaa86e05efa448b8059af6c927ceffd" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:54.362142  5030 raft_consensus.cc:2393] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a359ff757b3a4babb1229aa08bc44a60 in current term 9: Already voted for candidate 133eea4ce99644f5adbd12c985fc95cb in this term.
I20260709 12:14:54.362810  8057 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.363380  8057 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.365435  8057 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:54.373620  4997 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.374078  4997 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:54.374758  8083 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.376224  8042 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:54.376955  4481 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.377559  4481 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.379166  8083 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.380119  8081 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:54.385762  4997 leader_election.cc:336] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.386407  4997 leader_election.cc:336] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.386781  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.390761  8042 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:54.405230  8042 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.405871  8042 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.408177  8042 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:54.410209  4512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
W20260709 12:14:54.416396  4997 leader_election.cc:336] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.417160  4997 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:54.417994  8042 raft_consensus.cc:2749] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.453913  8083 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.454661  8083 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.459725  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.460441  5030 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 5.
I20260709 12:14:54.461201  8083 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.463050  4479 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
W20260709 12:14:54.464530  4481 leader_election.cc:336] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.468458  8083 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.469460  8083 raft_consensus.cc:493] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.469935  8083 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:54.499296  8083 raft_consensus.cc:515] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.503206  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10f0fcfdfbd34417af879705145ed5c6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb"
I20260709 12:14:54.503849  5030 raft_consensus.cc:3060] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:54.506745  4481 leader_election.cc:336] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.527170  8082 raft_consensus.cc:493] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.527915  8082 raft_consensus.cc:515] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.530478  8082 leader_election.cc:290] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.526809  8089 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.538020  8089 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.539134  8083 leader_election.cc:290] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.539794  5030 raft_consensus.cc:2468] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 6.
I20260709 12:14:54.548906  4479 leader_election.cc:304] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.549305  8089 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.549971  8089 raft_consensus.cc:2804] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:54.550444  8089 raft_consensus.cc:697] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Becoming Leader. State: Replica: a359ff757b3a4babb1229aa08bc44a60, State: Running, Role: LEADER
I20260709 12:14:54.551720  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.552641  8088 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.556645  8088 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.559957  8042 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.560544  8042 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.563184  8042 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:54.568804  8042 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.569334  8042 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.569710  5026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.558974  8088 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.572042  8042 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:54.572109  4997 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.572994  4997 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.573472  4997 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.574425  8042 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:54.541972  4481 leader_election.cc:336] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.555665  8089 consensus_queue.cc:237] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:54.576627  4481 leader_election.cc:336] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.577136  4481 leader_election.cc:304] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.580385  8088 raft_consensus.cc:2749] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.608197  8089 raft_consensus.cc:493] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.608817  8089 raft_consensus.cc:515] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.609413  4513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88fc213635c44d9584958cbc80077ad1" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:54.610097  4513 raft_consensus.cc:2468] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
I20260709 12:14:54.611178  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:54.611419  8089 leader_election.cc:290] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.615201  8089 raft_consensus.cc:493] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:14:54.615564  4997 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.615823  8089 raft_consensus.cc:515] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.618810  8081 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.619387  8081 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.622049  8081 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.621634  4261 catalog_manager.cc:5697] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195). New cstate: current_term: 6 leader_uuid: "a359ff757b3a4babb1229aa08bc44a60" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.626786  8083 raft_consensus.cc:493] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
W20260709 12:14:54.627592  4997 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.627404  8083 raft_consensus.cc:515] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.628023  4997 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.629601  8083 leader_election.cc:290] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.630432  8089 leader_election.cc:290] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.633000  8081 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:54.655709  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.657881  4481 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.661983  4481 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.662943  8089 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:54.659582  4997 leader_election.cc:336] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.664212  4997 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:54.664884  4997 leader_election.cc:336] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.665274  4997 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
W20260709 12:14:54.673207  4481 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.674384  4481 leader_election.cc:336] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.674808  4481 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.676863  8081 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.686170  8042 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.690042  8083 raft_consensus.cc:2749] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:54.690541  8042 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.692466  8042 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:54.729590  8089 raft_consensus.cc:493] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.730386  8089 raft_consensus.cc:515] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.733225  8089 leader_election.cc:290] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.752673  8083 raft_consensus.cc:493] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.753424  8083 raft_consensus.cc:515] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
W20260709 12:14:54.754606  4997 leader_election.cc:336] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.755556  4508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:54.756268  4508 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 4.
W20260709 12:14:54.755690  4481 leader_election.cc:336] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.756989  4481 leader_election.cc:336] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.757452  4481 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.758162  4481 leader_election.cc:336] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.755748  8083 leader_election.cc:290] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.758646  4481 leader_election.cc:304] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.759414  8083 raft_consensus.cc:2749] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:54.760100  4481 leader_election.cc:336] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.763195  4481 leader_election.cc:304] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.764096  8083 raft_consensus.cc:2749] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:54.764644  4481 leader_election.cc:336] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.765129  4481 leader_election.cc:304] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.768245  8083 raft_consensus.cc:2749] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.780465  8083 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.781061  8083 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.782788  8089 raft_consensus.cc:493] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.783353  8089 raft_consensus.cc:515] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.785182  8089 leader_election.cc:290] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.785645  8089 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.785755  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fa02f6f7e44052aa4ac9fc517789e6" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.786522  5030 raft_consensus.cc:2468] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a359ff757b3a4babb1229aa08bc44a60 in term 8.
I20260709 12:14:54.786100  8089 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.788573  8089 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.790671  4996 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.791941  8042 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:54.792274  8042 raft_consensus.cc:493] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.792594  8042 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:54.800837  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "a359ff757b3a4babb1229aa08bc44a60" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "133eea4ce99644f5adbd12c985fc95cb" is_pre_election: true
I20260709 12:14:54.801158  8042 raft_consensus.cc:515] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.801960  8083 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969)
I20260709 12:14:54.806975  8042 leader_election.cc:290] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:54.817899  4481 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.818531  4481 leader_election.cc:336] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.824563  4997 leader_election.cc:336] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.820283  4481 leader_election.cc:336] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.843444  4481 leader_election.cc:304] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.847112  8089 raft_consensus.cc:2749] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:54.847488  4481 leader_election.cc:336] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.848016  4481 leader_election.cc:304] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.848731  8089 raft_consensus.cc:2749] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.858906  4509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6942a9e429240fcb7987e82e7a08f52" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:54.859644  4509 raft_consensus.cc:3060] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:54.863914  4481 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.864465  4481 leader_election.cc:336] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:54.864899  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:54.868064  4509 raft_consensus.cc:2468] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
W20260709 12:14:54.876624  4481 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.877092  4481 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.877861  8089 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:54.878100  4481 leader_election.cc:336] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.878578  4481 leader_election.cc:304] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.879283  8089 raft_consensus.cc:2749] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:54.879446  4481 leader_election.cc:336] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.886193  4481 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 133eea4ce99644f5adbd12c985fc95cb, 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.886969  8089 raft_consensus.cc:2749] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.889163  4996 leader_election.cc:304] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:54.890334  8081 raft_consensus.cc:2804] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:54.890826  8081 raft_consensus.cc:697] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:54.891714  8081 consensus_queue.cc:237] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.912763  8081 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.913291  8081 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.913820  4261 catalog_manager.cc:5697] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 4 to 5, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 5 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:54.917945  8081 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:54.921159  4997 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.926564  8089 raft_consensus.cc:493] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.927266  8089 raft_consensus.cc:515] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:54.929642  8089 leader_election.cc:290] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.932168  8081 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.932736  8081 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.936555  8097 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.937206  8097 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:54.939512  8097 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:54.942082  4997 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:54.945524  4997 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.946357  8097 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:54.943842  8081 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:54.950253  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60" is_pre_election: true
I20260709 12:14:54.951074  4511 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 5.
W20260709 12:14:54.952503  4997 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:54.964807  4996 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 
I20260709 12:14:54.965989  8081 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:54.966454  8081 raft_consensus.cc:493] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:54.966866  8081 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:54.972281  4481 leader_election.cc:336] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.973102  4481 leader_election.cc:336] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.974924  4481 leader_election.cc:304] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:54.976761  8089 raft_consensus.cc:2749] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.978561  4253 maintenance_manager.cc:419] P 80c5c66c0e8a46988f2121bdd70f2876: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033397
W20260709 12:14:54.983371  4997 leader_election.cc:336] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.990509  4997 leader_election.cc:336] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:54.998353  4997 leader_election.cc:336] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:54.999038  4997 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:55.001436  8081 raft_consensus.cc:515] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:55.002408  8097 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:55.015393  4511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "649a2c7d074941a39496be2ed5768f58" candidate_uuid: "133eea4ce99644f5adbd12c985fc95cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a359ff757b3a4babb1229aa08bc44a60"
I20260709 12:14:55.016047  4511 raft_consensus.cc:3060] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:55.017812  8081 leader_election.cc:290] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Requested vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:55.024326  4511 raft_consensus.cc:2468] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 133eea4ce99644f5adbd12c985fc95cb in term 6.
W20260709 12:14:55.028020  4481 consensus_peers.cc:597] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.039311  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.033080  4997 leader_election.cc:336] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:55.045138  4996 leader_election.cc:304] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb, a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804
I20260709 12:14:55.046576  8097 raft_consensus.cc:2804] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:55.047154  8097 raft_consensus.cc:697] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Becoming Leader. State: Replica: 133eea4ce99644f5adbd12c985fc95cb, State: Running, Role: LEADER
I20260709 12:14:55.048050  8097 consensus_queue.cc:237] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:55.075491  5030 raft_consensus.cc:1275] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Refusing update from remote peer a359ff757b3a4babb1229aa08bc44a60: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:55.077877  8083 consensus_queue.cc:1048] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:55.086354  4261 catalog_manager.cc:5697] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb reported cstate change: term changed from 5 to 6, leader changed from 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194) to 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196). New cstate: current_term: 6 leader_uuid: "133eea4ce99644f5adbd12c985fc95cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:55.113400  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.163751  4997 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.207952  4481 consensus_peers.cc:597] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:55.244990  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.250216  4997 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.322696  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.333981  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.351008  4997 consensus_peers.cc:597] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.356500  4997 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.367192  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.395922  4481 consensus_peers.cc:597] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.395926  4997 consensus_peers.cc:597] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.402817  4511 raft_consensus.cc:1275] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:14:55.406280  8057 consensus_queue.cc:1048] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:55.419147  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.444111  3211 tablet_server.cc:196] TabletServer@127.3.34.194:0 shutdown complete.
I20260709 12:14:55.446727  4252 maintenance_manager.cc:643] P 80c5c66c0e8a46988f2121bdd70f2876: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.467s	user 0.141s	sys 0.039s Metrics: {"bytes_written":29682,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":17123,"dirs.run_cpu_time_us":377,"dirs.run_wall_time_us":9066,"drs_written":1,"lbm_read_time_us":344,"lbm_reads_lt_1ms":4,"lbm_write_time_us":12192,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":16767,"threads_started":1,"update_count":1}
W20260709 12:14:55.450441  4481 consensus_peers.cc:597] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.451114  4253 maintenance_manager.cc:419] P 80c5c66c0e8a46988f2121bdd70f2876: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12834 bytes on disk
I20260709 12:14:55.453279  4252 maintenance_manager.cc:643] P 80c5c66c0e8a46988f2121bdd70f2876: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":281,"lbm_reads_lt_1ms":4}
W20260709 12:14:55.457365  4997 consensus_peers.cc:597] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:55.473572  4481 consensus_peers.cc:597] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.529260  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.550603  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.562211  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.602736  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.603405  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.609617  4997 consensus_peers.cc:597] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.610705  4997 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:55.631302  4511 raft_consensus.cc:1275] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Refusing update from remote peer 133eea4ce99644f5adbd12c985fc95cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:14:55.636204  8081 consensus_queue.cc:1048] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:55.639045  4481 consensus_peers.cc:597] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.639784  4481 consensus_peers.cc:597] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.646953  4997 consensus_peers.cc:597] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.653226  4997 consensus_peers.cc:597] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:55.664088  4997 consensus_peers.cc:597] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.684630  4997 consensus_peers.cc:597] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:55.688640  4481 consensus_peers.cc:597] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.690483  4481 consensus_peers.cc:597] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.698107  4481 consensus_peers.cc:597] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.710525  4481 consensus_peers.cc:597] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.734548  4481 consensus_peers.cc:597] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:55.743696  4481 consensus_peers.cc:597] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.751031  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.756700  3211 tablet_server.cc:179] TabletServer@127.3.34.195:0 shutting down...
W20260709 12:14:55.784067  4481 consensus_peers.cc:597] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.828835  4481 consensus_peers.cc:597] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.835691  4997 consensus_peers.cc:597] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:55.862102  4996 consensus_peers.cc:597] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.868405  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:55.869820  3211 tablet_replica.cc:333] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.870779  3211 raft_consensus.cc:2243] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.871578  3211 raft_consensus.cc:2272] T c27395ba03b841e5969f26a9b223fe7d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.874713  3211 tablet_replica.cc:333] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.876984  3211 raft_consensus.cc:2243] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.878784  3211 raft_consensus.cc:2272] T b42d741e25d64c56a067245eb7cb14c2 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.881587  3211 tablet_replica.cc:333] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.882517  3211 raft_consensus.cc:2243] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.883314  3211 raft_consensus.cc:2272] T 0204e53e3fe3403ca1198afb918a0618 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.886013  3211 tablet_replica.cc:333] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.886888  3211 raft_consensus.cc:2243] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.888473  3211 raft_consensus.cc:2272] T 7c0f779e13cd4398b4596cccced22d75 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.891379  3211 tablet_replica.cc:333] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.892185  3211 raft_consensus.cc:2243] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.893275  3211 raft_consensus.cc:2272] T d0e2bd80ae11402a8a9e199424af5458 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.896348  3211 tablet_replica.cc:333] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.897248  3211 raft_consensus.cc:2243] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.898335  3211 raft_consensus.cc:2272] T abf6bd6bb7324271871b60ca568cc852 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.907054  3211 tablet_replica.cc:333] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.907989  3211 raft_consensus.cc:2243] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.909163  3211 raft_consensus.cc:2272] T a003a2ac88974139bde682ffd3dea64c P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.912393  3211 tablet_replica.cc:333] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.913280  3211 raft_consensus.cc:2243] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.923864  3211 raft_consensus.cc:2272] T c4f82f0bdef64f9787ddce96e1f85660 P a359ff757b3a4babb1229aa08bc44a60 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.924809  4481 consensus_peers.cc:597] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.926893  3211 tablet_replica.cc:333] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
W20260709 12:14:55.937122  4997 consensus_peers.cc:597] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:55.938099  3211 raft_consensus.cc:2243] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.939281  3211 raft_consensus.cc:2272] T e9b9bc6664cb46d1b1ccf0965abab439 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.946362  3211 tablet_replica.cc:333] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.946823  8089 raft_consensus.cc:493] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:55.947400  8089 raft_consensus.cc:515] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } }
I20260709 12:14:55.949568  8089 leader_election.cc:290] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:55.950909  3211 raft_consensus.cc:2243] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.952099  3211 raft_consensus.cc:2272] T 48a5885ca40b49f9a79c3ae930090feb P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.959249  4481 leader_election.cc:336] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:55.961380  4481 leader_election.cc:336] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:55.961705  3211 tablet_replica.cc:333] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.961911  4481 leader_election.cc:304] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a359ff757b3a4babb1229aa08bc44a60; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:55.962674  3211 raft_consensus.cc:2243] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.963017  8089 raft_consensus.cc:2749] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.963828  3211 raft_consensus.cc:2272] T caaa86e05efa448b8059af6c927ceffd P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.966965  4996 consensus_peers.cc:597] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.969663  3211 tablet_replica.cc:333] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.970548  3211 raft_consensus.cc:2243] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.971201  3211 raft_consensus.cc:2272] T b524dfc86657460e8841456102df7e40 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.978341  4996 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.980495  3211 tablet_replica.cc:333] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.982663  3211 raft_consensus.cc:2243] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.983481  3211 raft_consensus.cc:2272] T 632d1ea17544468d8db4dfec9893bc7d P a359ff757b3a4babb1229aa08bc44a60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.986332  3211 tablet_replica.cc:333] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.987150  3211 raft_consensus.cc:2243] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.987967  3211 raft_consensus.cc:2272] T 45fa02f6f7e44052aa4ac9fc517789e6 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.991658  3211 tablet_replica.cc:333] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.992487  3211 raft_consensus.cc:2243] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.993582  3211 raft_consensus.cc:2272] T bdb8329d46e44c7bbc1100c6da0c55b1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.996511  3211 tablet_replica.cc:333] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:55.997310  3211 raft_consensus.cc:2243] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.998369  3211 raft_consensus.cc:2272] T 113336c186624ff989dd5bad91201a95 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.008459  3211 tablet_replica.cc:333] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.009546  3211 raft_consensus.cc:2243] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.010284  3211 raft_consensus.cc:2272] T 0850ebb64cfc469fb421b34b4c89537e P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.015173  3211 tablet_replica.cc:333] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.016119  3211 raft_consensus.cc:2243] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:56.017187  4996 consensus_peers.cc:597] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.058207  3211 raft_consensus.cc:2272] T e4d2f3f375e94f79a0dd385679b944aa P a359ff757b3a4babb1229aa08bc44a60 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.060534  4997 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:56.073405  4996 consensus_peers.cc:597] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.075263  3211 tablet_replica.cc:333] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.076277  3211 raft_consensus.cc:2243] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.080116  3211 raft_consensus.cc:2272] T c34020fa889c4752979db51ac86d3251 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.086565  3211 tablet_replica.cc:333] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
W20260709 12:14:56.092828  4996 consensus_peers.cc:597] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.097055  3211 raft_consensus.cc:2243] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.098310  3211 raft_consensus.cc:2272] T d7aa6aedab9d4e14b16124d91af2f154 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.103503  4996 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.110910  4996 consensus_peers.cc:597] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.124138  3211 tablet_replica.cc:333] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.129374  3211 raft_consensus.cc:2243] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.130394  3211 raft_consensus.cc:2272] T 0d85ac676e004b609f70d47ae2ac3c44 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.128181  4997 consensus_peers.cc:597] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:56.136466  3211 tablet_replica.cc:333] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
W20260709 12:14:56.147673  4996 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.161871  4996 consensus_peers.cc:597] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.160300  3211 raft_consensus.cc:2243] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.166826  3211 raft_consensus.cc:2272] T 88fc213635c44d9584958cbc80077ad1 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.169874  3211 tablet_replica.cc:333] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
W20260709 12:14:56.176824  4996 consensus_peers.cc:597] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.180549  3211 raft_consensus.cc:2243] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.183120  3211 raft_consensus.cc:2272] T 9abe6120f15d41dd8f67749ea3529089 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.186436  3211 tablet_replica.cc:333] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.187428  3211 raft_consensus.cc:2243] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.188176  3211 raft_consensus.cc:2272] T c1602309b0f64e5da65bbe212dcd8578 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.191511  3211 tablet_replica.cc:333] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
W20260709 12:14:56.204624  4996 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.195685  3211 raft_consensus.cc:2243] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:56.207916  4481 consensus_peers.cc:597] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 -> Peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Couldn't send request to peer 6b40d129d452470ba95c63b1eb11f804. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:56.210732  3211 raft_consensus.cc:2272] T c6942a9e429240fcb7987e82e7a08f52 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.211681  4996 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.213291  4996 consensus_peers.cc:597] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.214569  3211 tablet_replica.cc:333] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.215585  3211 raft_consensus.cc:2243] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.216897  3211 raft_consensus.cc:2272] T d27bb118c5cf4d81b9951fd5ed73bf31 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.219960  3211 tablet_replica.cc:333] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.220862  3211 raft_consensus.cc:2243] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.221657  3211 raft_consensus.cc:2272] T 2e80f7c2589340f0b76dfe7449339a9d P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.226915  8057 raft_consensus.cc:493] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:56.227537  8057 raft_consensus.cc:515] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.229660  8057 leader_election.cc:290] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:56.235743  4996 consensus_peers.cc:597] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.243208  4997 leader_election.cc:336] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:56.245654  4997 leader_election.cc:336] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:56.246222  4997 leader_election.cc:304] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:56.247923  8057 raft_consensus.cc:2749] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.252533  3211 tablet_replica.cc:333] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.257700  3211 raft_consensus.cc:2243] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:14:56.261562  4997 consensus_peers.cc:597] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:56.276103  3211 raft_consensus.cc:2272] T 10f0fcfdfbd34417af879705145ed5c6 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.279129  3211 tablet_replica.cc:333] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.280175  3211 raft_consensus.cc:2243] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.280824  3211 raft_consensus.cc:2272] T a4f3505d639448bc9bf52e138a226844 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.283798  3211 tablet_replica.cc:333] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.284653  3211 raft_consensus.cc:2243] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.285423  3211 raft_consensus.cc:2272] T 2c050a61816f48f59f2cefc96a79621d P a359ff757b3a4babb1229aa08bc44a60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.288349  3211 tablet_replica.cc:333] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.289201  3211 raft_consensus.cc:2243] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.290446  3211 raft_consensus.cc:2272] T 8afbdad4342642f89b3c8be7ce7da5dc P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.293362  3211 tablet_replica.cc:333] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.294283  3211 raft_consensus.cc:2243] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.295514  3211 raft_consensus.cc:2272] T 19356d2adb334f6fa9ec07c452d14046 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.298537  3211 tablet_replica.cc:333] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.299520  3211 raft_consensus.cc:2243] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:56.299703  4997 consensus_peers.cc:597] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:56.300320  3211 raft_consensus.cc:2272] T 414c481bb7ad485898e5ed66d8a38344 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.302932  3211 tablet_replica.cc:333] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.303864  3211 raft_consensus.cc:2243] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.304628  3211 raft_consensus.cc:2272] T 92ab6cc386d54892aeefaf3825ef65ee P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.307526  3211 tablet_replica.cc:333] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.308434  3211 raft_consensus.cc:2243] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.309136  3211 raft_consensus.cc:2272] T 649a2c7d074941a39496be2ed5768f58 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.311018  4997 consensus_peers.cc:597] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:56.312450  3211 tablet_replica.cc:333] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.313383  3211 raft_consensus.cc:2243] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.314129  3211 raft_consensus.cc:2272] T 049f37cd99a74aec952c95bcc63588b9 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.316964  3211 tablet_replica.cc:333] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.317800  3211 raft_consensus.cc:2243] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.319119  3211 raft_consensus.cc:2272] T a04eae5aed3946b19b6d1c1b40af70ca P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.322079  3211 tablet_replica.cc:333] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.323082  3211 raft_consensus.cc:2243] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.324276  3211 raft_consensus.cc:2272] T 6f130dbf22aa4fec863590cd97a47f17 P a359ff757b3a4babb1229aa08bc44a60 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.327039  3211 tablet_replica.cc:333] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.327659  3211 raft_consensus.cc:2243] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.328323  3211 raft_consensus.cc:2272] T f841988974fd4cd9a66ea124b9b9b284 P a359ff757b3a4babb1229aa08bc44a60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.332691  3211 tablet_replica.cc:333] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.333279  3211 raft_consensus.cc:2243] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.333832  3211 raft_consensus.cc:2272] T 549e3d5d3452435687b34025926eb9d3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.336061  3211 tablet_replica.cc:333] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.336661  3211 raft_consensus.cc:2243] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.337630  3211 raft_consensus.cc:2272] T 8fc38aad677b4e24b4c61a7d79c8e8e3 P a359ff757b3a4babb1229aa08bc44a60 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.339954  3211 tablet_replica.cc:333] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.340536  3211 raft_consensus.cc:2243] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:56.341470  3211 raft_consensus.cc:2272] T f0eddf8c8603444b95052dfcd6ec14ca P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.343819  3211 tablet_replica.cc:333] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.344424  3211 raft_consensus.cc:2243] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.344976  3211 raft_consensus.cc:2272] T b53244c88a364677a229b3af6a2c00ac P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.348021  3211 tablet_replica.cc:333] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.348755  3211 raft_consensus.cc:2243] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.349718  3211 raft_consensus.cc:2272] T 7d8bef78062e4451b98d19e752efb309 P a359ff757b3a4babb1229aa08bc44a60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.352685  3211 tablet_replica.cc:333] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.353615  3211 raft_consensus.cc:2243] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.354194  3211 raft_consensus.cc:2272] T 011d2125e98642bfaa9d1a5c58747e7e P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:56.356959  3211 tablet_replica.cc:333] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60: stopping tablet replica
I20260709 12:14:56.357620  3211 raft_consensus.cc:2243] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:56.358258  3211 raft_consensus.cc:2272] T d90f9248ceaf4ba3937a4604adcb0295 P a359ff757b3a4babb1229aa08bc44a60 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:56.367159  4996 consensus_peers.cc:597] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb -> Peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Couldn't send request to peer a359ff757b3a4babb1229aa08bc44a60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.514197  4997 consensus_peers.cc:597] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:56.631390  8057 raft_consensus.cc:493] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.631903  8057 raft_consensus.cc:515] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.633823  8057 leader_election.cc:290] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:56.638078  8109 raft_consensus.cc:493] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:56.638682  8109 raft_consensus.cc:515] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.748204  8109 leader_election.cc:290] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
I20260709 12:14:56.752576  8109 raft_consensus.cc:493] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:56.755632  8109 raft_consensus.cc:515] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.758551  8109 leader_election.cc:290] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:56.759289  8109 raft_consensus.cc:493] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:56.759977  8109 raft_consensus.cc:515] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.762531  8109 leader_election.cc:290] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
W20260709 12:14:56.793336  4996 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:56.794471  4996 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
I20260709 12:14:56.800370  8119 raft_consensus.cc:493] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:56.801355  8119 raft_consensus.cc:515] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } attrs { replace: true } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:56.804826  8119 leader_election.cc:290] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:56.808876  4997 leader_election.cc:336] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:56.809345  4997 leader_election.cc:304] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:56.810894  8119 raft_consensus.cc:2749] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:56.812115  4996 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:56.818041  4997 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:56.818532  4997 leader_election.cc:304] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:56.819182  8119 raft_consensus.cc:2749] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:56.819284  4997 consensus_peers.cc:597] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:56.819813  4997 leader_election.cc:336] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:56.820210  4997 leader_election.cc:336] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:56.822060  4997 leader_election.cc:336] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:56.823073  4997 leader_election.cc:336] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:56.823783  4997 leader_election.cc:304] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:56.824738  8119 raft_consensus.cc:2749] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:56.825832  4997 leader_election.cc:336] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:56.827517  4997 leader_election.cc:304] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:56.828303  8119 raft_consensus.cc:2749] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:56.834012  4997 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:56.834787  4997 leader_election.cc:304] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:56.835608  8119 raft_consensus.cc:2749] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:56.836652  4997 leader_election.cc:336] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:57.013110  4997 consensus_peers.cc:597] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.031224  8119 raft_consensus.cc:493] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.031997  8119 raft_consensus.cc:515] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } attrs { replace: true } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:57.044569  4996 leader_election.cc:336] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
I20260709 12:14:57.045857  8119 leader_election.cc:290] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.054085  4997 leader_election.cc:336] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:57.054692  4997 leader_election.cc:304] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.055527  8119 raft_consensus.cc:2749] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:57.055720  4997 leader_election.cc:336] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.068403  8119 raft_consensus.cc:493] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.068907  8119 raft_consensus.cc:515] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.070675  8121 raft_consensus.cc:493] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:57.071365  8121 raft_consensus.cc:515] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.073452  8121 leader_election.cc:290] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:57.070711  8119 leader_election.cc:290] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.080255  4996 leader_election.cc:336] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:57.081121  4997 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
W20260709 12:14:57.082355  4997 leader_election.cc:336] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:57.082773  4997 leader_election.cc:304] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.083426  8119 raft_consensus.cc:2749] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:57.083753  4997 leader_election.cc:336] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:57.084178  4997 leader_election.cc:304] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:57.084828  8119 raft_consensus.cc:2749] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.163235  3211 tablet_server.cc:196] TabletServer@127.3.34.195:0 shutdown complete.
I20260709 12:14:57.169430  8119 raft_consensus.cc:493] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6b40d129d452470ba95c63b1eb11f804)
I20260709 12:14:57.170064  8119 raft_consensus.cc:515] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.171962  8119 leader_election.cc:290] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573)
I20260709 12:14:57.173965  8119 raft_consensus.cc:493] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.174528  8119 raft_consensus.cc:515] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:57.177944  4997 leader_election.cc:336] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:14:57.178743  4997 leader_election.cc:336] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.179247  4997 leader_election.cc:304] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, 6f6e8442c230466296caa54a80810609
I20260709 12:14:57.180320  8121 raft_consensus.cc:2749] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.182718  8119 leader_election.cc:290] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.186168  4996 leader_election.cc:336] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:57.188781  4997 leader_election.cc:336] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.189289  4997 leader_election.cc:304] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.190125  8119 raft_consensus.cc:2749] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:57.224911  8119 raft_consensus.cc:493] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.225425  8119 raft_consensus.cc:515] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6f6e8442c230466296caa54a80810609" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41885 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.227484  8119 leader_election.cc:290] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.233101  4996 leader_election.cc:336] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:57.237478  4997 leader_election.cc:336] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
I20260709 12:14:57.238119  4997 leader_election.cc:304] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6f6e8442c230466296caa54a80810609, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.242120  8121 raft_consensus.cc:2749] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.295352  8120 raft_consensus.cc:493] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.296046  8120 raft_consensus.cc:515] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
W20260709 12:14:57.306437  4996 leader_election.cc:336] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
I20260709 12:14:57.307467  8120 leader_election.cc:290] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.314019  4997 leader_election.cc:336] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.314662  4997 leader_election.cc:304] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.315601  8120 raft_consensus.cc:2749] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:57.315874  3211 tablet_server.cc:179] TabletServer@127.3.34.196:0 shutting down...
I20260709 12:14:57.328886  8120 raft_consensus.cc:493] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.329487  8120 raft_consensus.cc:515] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.334827  8120 leader_election.cc:290] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.339991  4996 leader_election.cc:336] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
W20260709 12:14:57.340828  4997 leader_election.cc:336] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.341315  4997 leader_election.cc:304] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.342072  8120 raft_consensus.cc:2749] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:57.360690  4997 consensus_peers.cc:597] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb -> Peer 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): Couldn't send request to peer 6f6e8442c230466296caa54a80810609. Status: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:57.365752  8114 raft_consensus.cc:493] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a359ff757b3a4babb1229aa08bc44a60)
I20260709 12:14:57.366379  8114 raft_consensus.cc:515] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6b40d129d452470ba95c63b1eb11f804" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 33573 } } peers { permanent_uuid: "a359ff757b3a4babb1229aa08bc44a60" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 46537 } } peers { permanent_uuid: "133eea4ce99644f5adbd12c985fc95cb" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 34969 } attrs { promote: false } }
I20260709 12:14:57.368721  8114 leader_election.cc:290] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573), a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537)
W20260709 12:14:57.374097  4996 leader_election.cc:336] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a359ff757b3a4babb1229aa08bc44a60 (127.3.34.195:46537): Network error: Client connection negotiation failed: client connection to 127.3.34.195:46537: connect: Connection refused (error 111)
I20260709 12:14:57.376088  3211 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:57.379307  3211 tablet_replica.cc:333] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.380278  3211 raft_consensus.cc:2243] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.380336  4997 leader_election.cc:336] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6b40d129d452470ba95c63b1eb11f804 (127.3.34.194:33573): Network error: Client connection negotiation failed: client connection to 127.3.34.194:33573: connect: Connection refused (error 111)
I20260709 12:14:57.380796  4997 leader_election.cc:304] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 133eea4ce99644f5adbd12c985fc95cb; no voters: 6b40d129d452470ba95c63b1eb11f804, a359ff757b3a4babb1229aa08bc44a60
I20260709 12:14:57.381187  3211 raft_consensus.cc:2272] T caaa86e05efa448b8059af6c927ceffd P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.381515  8120 raft_consensus.cc:2749] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:57.384174  3211 tablet_replica.cc:333] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.384907  3211 raft_consensus.cc:2243] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.385475  3211 raft_consensus.cc:2272] T 3b3ddaccf4b5439b920d6b4aaeaa2e64 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.387777  3211 tablet_replica.cc:333] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.388424  3211 raft_consensus.cc:2243] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.388866  3211 raft_consensus.cc:2272] T 10f0fcfdfbd34417af879705145ed5c6 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.390920  3211 tablet_replica.cc:333] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.391613  3211 raft_consensus.cc:2243] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.392580  3211 raft_consensus.cc:2272] T 7d8bef78062e4451b98d19e752efb309 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.394796  3211 tablet_replica.cc:333] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.395412  3211 raft_consensus.cc:2243] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.395944  3211 raft_consensus.cc:2272] T 3eb5c6cd99c34c058da3556e59e8e01c P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.398154  3211 tablet_replica.cc:333] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.398792  3211 raft_consensus.cc:2243] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.399353  3211 raft_consensus.cc:2272] T e9b9bc6664cb46d1b1ccf0965abab439 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.401314  3211 tablet_replica.cc:333] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.401880  3211 raft_consensus.cc:2243] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.402371  3211 raft_consensus.cc:2272] T 45fa02f6f7e44052aa4ac9fc517789e6 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.404820  3211 tablet_replica.cc:333] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.405560  3211 raft_consensus.cc:2243] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.406149  4997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111) [suppressed 636 similar messages]
I20260709 12:14:57.406257  3211 raft_consensus.cc:2272] T bdb8329d46e44c7bbc1100c6da0c55b1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.409076  3211 tablet_replica.cc:333] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.409691  3211 raft_consensus.cc:2243] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.410234  3211 raft_consensus.cc:2272] T 9abe6120f15d41dd8f67749ea3529089 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.412396  3211 tablet_replica.cc:333] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.413000  3211 raft_consensus.cc:2243] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.413533  3211 raft_consensus.cc:2272] T b42d741e25d64c56a067245eb7cb14c2 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.415758  3211 tablet_replica.cc:333] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.416400  3211 raft_consensus.cc:2243] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.417202  3211 raft_consensus.cc:2272] T e4d2f3f375e94f79a0dd385679b944aa P 133eea4ce99644f5adbd12c985fc95cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.419253  3211 tablet_replica.cc:333] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.419806  3211 raft_consensus.cc:2243] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.420876  3211 raft_consensus.cc:2272] T 011d2125e98642bfaa9d1a5c58747e7e P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.423100  3211 tablet_replica.cc:333] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.423734  3211 raft_consensus.cc:2243] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.424536  3211 raft_consensus.cc:2272] T f841988974fd4cd9a66ea124b9b9b284 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.426672  3211 tablet_replica.cc:333] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.427309  3211 raft_consensus.cc:2243] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.428117  3211 raft_consensus.cc:2272] T 414c481bb7ad485898e5ed66d8a38344 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.430475  3211 tablet_replica.cc:333] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.431350  3211 raft_consensus.cc:2243] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.432319  3211 raft_consensus.cc:2272] T 1f28d6bc26fc4caeac04b56caf240716 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.434614  3211 tablet_replica.cc:333] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.435261  3211 raft_consensus.cc:2243] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.436123  3211 raft_consensus.cc:2272] T b524dfc86657460e8841456102df7e40 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.438298  3211 tablet_replica.cc:333] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.440032  3211 raft_consensus.cc:2243] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.440486  3211 raft_consensus.cc:2272] T 8afbdad4342642f89b3c8be7ce7da5dc P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.442939  3211 tablet_replica.cc:333] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.443573  3211 raft_consensus.cc:2243] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.444427  3211 raft_consensus.cc:2272] T 649a2c7d074941a39496be2ed5768f58 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.446360  3211 tablet_replica.cc:333] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.446921  3211 raft_consensus.cc:2243] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.447935  3211 raft_consensus.cc:2272] T d7aa6aedab9d4e14b16124d91af2f154 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.451669  3211 tablet_replica.cc:333] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.452314  3211 raft_consensus.cc:2243] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.453222  3211 raft_consensus.cc:2272] T 2e80f7c2589340f0b76dfe7449339a9d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.455472  3211 tablet_replica.cc:333] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.456069  3211 raft_consensus.cc:2243] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.456966  3211 raft_consensus.cc:2272] T c6942a9e429240fcb7987e82e7a08f52 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.459045  3211 tablet_replica.cc:333] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.459625  3211 raft_consensus.cc:2243] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.460387  3211 raft_consensus.cc:2272] T c1602309b0f64e5da65bbe212dcd8578 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.462455  3211 tablet_replica.cc:333] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.463125  3211 raft_consensus.cc:2243] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.463896  3211 raft_consensus.cc:2272] T 5d34886e28324e3a9e84a6ecb6b1b615 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.466737  3211 tablet_replica.cc:333] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.467473  3211 raft_consensus.cc:2243] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.468451  3211 raft_consensus.cc:2272] T cd282266b4fc4ef98c399a7ea99210df P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.471089  3211 tablet_replica.cc:333] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.471820  3211 raft_consensus.cc:2243] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.472271  3211 raft_consensus.cc:2272] T d27bb118c5cf4d81b9951fd5ed73bf31 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.474516  3211 tablet_replica.cc:333] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.475199  3211 raft_consensus.cc:2243] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.475708  3211 raft_consensus.cc:2272] T 66db2395fb8d472bae50ea6bda5a63f8 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.477779  3211 tablet_replica.cc:333] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.478340  3211 raft_consensus.cc:2243] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.479244  3211 raft_consensus.cc:2272] T 2c050a61816f48f59f2cefc96a79621d P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.481420  3211 tablet_replica.cc:333] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.482007  3211 raft_consensus.cc:2243] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.482836  3211 raft_consensus.cc:2272] T 1c0ed95ce6be4de980a07c4834b46498 P 133eea4ce99644f5adbd12c985fc95cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.485261  3211 tablet_replica.cc:333] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.485805  3211 raft_consensus.cc:2243] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.486266  3211 raft_consensus.cc:2272] T a04eae5aed3946b19b6d1c1b40af70ca P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.488420  3211 tablet_replica.cc:333] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.488962  3211 raft_consensus.cc:2243] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.489786  3211 raft_consensus.cc:2272] T 049f37cd99a74aec952c95bcc63588b9 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.491886  3211 tablet_replica.cc:333] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.492478  3211 raft_consensus.cc:2243] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.492964  3211 raft_consensus.cc:2272] T 19356d2adb334f6fa9ec07c452d14046 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.495028  3211 tablet_replica.cc:333] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.495570  3211 raft_consensus.cc:2243] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.496023  3211 raft_consensus.cc:2272] T 8ace27fd51bc488ca513d42f77ae9744 P 133eea4ce99644f5adbd12c985fc95cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.498045  3211 tablet_replica.cc:333] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.498560  3211 raft_consensus.cc:2243] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.499433  3211 raft_consensus.cc:2272] T c27395ba03b841e5969f26a9b223fe7d P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.501544  3211 tablet_replica.cc:333] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.503471  3211 raft_consensus.cc:2243] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.504050  3211 raft_consensus.cc:2272] T 88fc213635c44d9584958cbc80077ad1 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.506120  3211 tablet_replica.cc:333] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.506685  3211 raft_consensus.cc:2243] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.507548  3211 raft_consensus.cc:2272] T a8f3e66082564439be8a3b4a0292e958 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.509963  3211 tablet_replica.cc:333] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.510653  3211 raft_consensus.cc:2243] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.511745  3211 raft_consensus.cc:2272] T 0d85ac676e004b609f70d47ae2ac3c44 P 133eea4ce99644f5adbd12c985fc95cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.514279  3211 tablet_replica.cc:333] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.514809  3211 raft_consensus.cc:2243] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.515367  3211 raft_consensus.cc:2272] T 9a539d67362a4305b85e3c294bc7c2a8 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.517302  3211 tablet_replica.cc:333] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.517799  3211 raft_consensus.cc:2243] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.518568  3211 raft_consensus.cc:2272] T cb845b83c8c64fc6add1f32cc9fd1f12 P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.520527  3211 tablet_replica.cc:333] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.521008  3211 raft_consensus.cc:2243] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.521755  3211 raft_consensus.cc:2272] T 3568f45f51034aec8216f626ea0759ea P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.523676  3211 tablet_replica.cc:333] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.524263  3211 raft_consensus.cc:2243] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.524713  3211 raft_consensus.cc:2272] T 7c0f779e13cd4398b4596cccced22d75 P 133eea4ce99644f5adbd12c985fc95cb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.526811  3211 tablet_replica.cc:333] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.527328  3211 raft_consensus.cc:2243] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.527792  3211 raft_consensus.cc:2272] T a003a2ac88974139bde682ffd3dea64c P 133eea4ce99644f5adbd12c985fc95cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.529717  3211 tablet_replica.cc:333] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.530344  3211 raft_consensus.cc:2243] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.530769  3211 raft_consensus.cc:2272] T 6f130dbf22aa4fec863590cd97a47f17 P 133eea4ce99644f5adbd12c985fc95cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.532871  3211 tablet_replica.cc:333] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.533378  3211 raft_consensus.cc:2243] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.534489  3211 raft_consensus.cc:2272] T 632d1ea17544468d8db4dfec9893bc7d P 133eea4ce99644f5adbd12c985fc95cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.536568  3211 tablet_replica.cc:333] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb: stopping tablet replica
I20260709 12:14:57.537035  3211 raft_consensus.cc:2243] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.537750  3211 raft_consensus.cc:2272] T f4c35d8d5d0b41aca58011ae22cd5c02 P 133eea4ce99644f5adbd12c985fc95cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.639973  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08000605c0 after lost signal to thread 3214
W20260709 12:14:57.640969  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec760 after lost signal to thread 4298
W20260709 12:14:57.642023  5052 debug-util.cc:398] Leaking SignalData structure 0x7b08003e65c0 after lost signal to thread 5055
W20260709 12:14:58.614497  3211 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5052)
I20260709 12:14:59.036772  3211 tablet_server.cc:196] TabletServer@127.3.34.196:0 shutdown complete.
I20260709 12:14:59.192525  3211 master.cc:562] Master@127.3.34.254:42447 shutting down...
W20260709 12:14:59.230204  4312 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:14:59.230492  4312 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:59.230728  4312 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:15:02.212867  4251 catalog_manager.cc:4755] TS 6f6e8442c230466296caa54a80810609 (127.3.34.193:41885): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet caaa86e05efa448b8059af6c927ceffd: Network error: Client connection negotiation failed: client connection to 127.3.34.193:41885: connect: Connection refused (error 111)
W20260709 12:15:10.548581  4295 debug-util.cc:398] Leaking SignalData structure 0x7b0800301d00 after lost signal to thread 3214
W20260709 12:15:10.549157  4295 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb520 after lost signal to thread 4298
W20260709 12:15:17.249106  4249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.34.196:34969: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260709 12:15:17.253109  4249 catalog_manager.cc:4755] TS 133eea4ce99644f5adbd12c985fc95cb (127.3.34.196:34969): ChangeConfig:REMOVE_PEER RPC failed for tablet 011d2125e98642bfaa9d1a5c58747e7e: Network error: Client connection negotiation failed: client connection to 127.3.34.196:34969: connect: Connection refused (error 111)
I20260709 12:15:20.511715  3211 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.512962  3211 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.513401  3211 tablet_replica.cc:333] T 00000000000000000000000000000000 P 80c5c66c0e8a46988f2121bdd70f2876: stopping tablet replica
I20260709 12:15:20.627064  3211 master.cc:584] Master@127.3.34.254:42447 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (146136 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:15:20.746021  3211 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.34.254:33989
I20260709 12:15:20.747520  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:20.754051  8130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.754374  8131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.756158  8133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:20.756183  3211 server_base.cc:1061] running on GCE node
I20260709 12:15:20.759172  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:20.759449  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:20.759651  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599320759616 us; error 0 us; skew 500 ppm
I20260709 12:15:20.760237  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:20.763460  3211 webserver.cc:533] Webserver started at http://127.3.34.254:41007/ using document root <none> and password file <none>
I20260709 12:15:20.764096  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:20.764343  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:20.764698  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:20.766145  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/master-0-root/instance:
uuid: "a67383a069d847498ac30faca211ab02"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-x5d7"
I20260709 12:15:20.771495  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:15:20.775789  8138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.776580  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:15:20.776909  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/master-0-root
uuid: "a67383a069d847498ac30faca211ab02"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-x5d7"
I20260709 12:15:20.777251  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:20.788697  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:20.789987  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:20.831707  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.254:33989
I20260709 12:15:20.831821  8189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.254:33989 every 8 connection(s)
I20260709 12:15:20.836134  8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.847451  8190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02: Bootstrap starting.
I20260709 12:15:20.852615  8190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.857304  8190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02: No bootstrap required, opened a new log
I20260709 12:15:20.859840  8190 raft_consensus.cc:359] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER }
I20260709 12:15:20.860291  8190 raft_consensus.cc:385] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.860586  8190 raft_consensus.cc:740] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67383a069d847498ac30faca211ab02, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.861194  8190 consensus_queue.cc:260] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER }
I20260709 12:15:20.861675  8190 raft_consensus.cc:399] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:20.861905  8190 raft_consensus.cc:493] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:20.862212  8190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.866964  8190 raft_consensus.cc:515] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER }
I20260709 12:15:20.867588  8190 leader_election.cc:304] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a67383a069d847498ac30faca211ab02; no voters: 
I20260709 12:15:20.868839  8190 leader_election.cc:290] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:20.869313  8193 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.870723  8193 raft_consensus.cc:697] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [term 1 LEADER]: Becoming Leader. State: Replica: a67383a069d847498ac30faca211ab02, State: Running, Role: LEADER
I20260709 12:15:20.871501  8193 consensus_queue.cc:237] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER }
I20260709 12:15:20.872031  8190 sys_catalog.cc:565] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:20.881183  8194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a67383a069d847498ac30faca211ab02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER } }
I20260709 12:15:20.882014  8194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:20.881824  8195 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a67383a069d847498ac30faca211ab02. Latest consensus state: current_term: 1 leader_uuid: "a67383a069d847498ac30faca211ab02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67383a069d847498ac30faca211ab02" member_type: VOTER } }
I20260709 12:15:20.882773  8195 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:20.888284  8203 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:20.893276  8203 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:20.894555  3211 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:20.902711  8203 catalog_manager.cc:1383] Generated new cluster ID: 397761750f6a44a090a065c0d5704821
I20260709 12:15:20.902998  8203 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:20.934818  8203 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:20.936287  8203 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:20.952252  8203 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a67383a069d847498ac30faca211ab02: Generated new TSK 0
I20260709 12:15:20.952881  8203 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:20.961768  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:20.968498  8211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.969302  8212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:20.970816  8214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:20.972105  3211 server_base.cc:1061] running on GCE node
I20260709 12:15:20.974546  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:20.974764  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:20.975031  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599320974974 us; error 0 us; skew 500 ppm
I20260709 12:15:20.975682  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:20.978281  3211 webserver.cc:533] Webserver started at http://127.3.34.193:46479/ using document root <none> and password file <none>
I20260709 12:15:20.978828  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:20.979075  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:20.979403  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:20.980690  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/instance:
uuid: "29d436e9d3d54fe599d9aa67d38fba03"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-x5d7"
I20260709 12:15:20.985982  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 12:15:20.989605  8219 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:20.990510  3211 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:20.990816  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
uuid: "29d436e9d3d54fe599d9aa67d38fba03"
format_stamp: "Formatted at 2026-07-09 12:15:20 on dist-test-slave-x5d7"
I20260709 12:15:20.991168  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.031028  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.032334  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.033970  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.036448  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.036682  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.036948  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.037143  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.081709  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.193:41731
I20260709 12:15:21.081833  8281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.193:41731 every 8 connection(s)
I20260709 12:15:21.087458  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.096158  8286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.098739  8287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.101925  3211 server_base.cc:1061] running on GCE node
W20260709 12:15:21.102116  8289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.103370  8282 heartbeater.cc:344] Connected to a master server at 127.3.34.254:33989
I20260709 12:15:21.103832  8282 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:21.104496  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:21.104743  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.104839  8282 heartbeater.cc:507] Master 127.3.34.254:33989 requested a full tablet report, sending...
I20260709 12:15:21.104959  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599321104923 us; error 0 us; skew 500 ppm
I20260709 12:15:21.105801  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.107573  8155 ts_manager.cc:194] Registered new tserver with Master: 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:21.108889  3211 webserver.cc:533] Webserver started at http://127.3.34.194:37045/ using document root <none> and password file <none>
I20260709 12:15:21.109624  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.109865  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.110163  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.110335  8155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37602
I20260709 12:15:21.111847  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/instance:
uuid: "70ae764f2abd44229023295f5cc6bf37"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.116755  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:15:21.120581  8294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.121532  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:15:21.121862  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
uuid: "70ae764f2abd44229023295f5cc6bf37"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.122176  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.142032  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.143412  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.144985  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.147478  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.147729  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.147980  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.148155  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.193811  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.194:39513
I20260709 12:15:21.193936  8356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.194:39513 every 8 connection(s)
I20260709 12:15:21.199015  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.206643  8360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.207343  8361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.211239  3211 server_base.cc:1061] running on GCE node
W20260709 12:15:21.211319  8364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.212764  8357 heartbeater.cc:344] Connected to a master server at 127.3.34.254:33989
I20260709 12:15:21.212770  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:21.213299  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.213411  8357 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:21.213533  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599321213517 us; error 0 us; skew 500 ppm
I20260709 12:15:21.214349  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.214367  8357 heartbeater.cc:507] Master 127.3.34.254:33989 requested a full tablet report, sending...
I20260709 12:15:21.216938  8155 ts_manager.cc:194] Registered new tserver with Master: 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:21.217424  3211 webserver.cc:533] Webserver started at http://127.3.34.195:38445/ using document root <none> and password file <none>
I20260709 12:15:21.218111  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.218374  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.218693  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.219017  8155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37604
I20260709 12:15:21.220369  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/instance:
uuid: "b3421ee20b674b879e0633e39c5709d7"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.225427  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:15:21.229260  8368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.230298  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:15:21.230702  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
uuid: "b3421ee20b674b879e0633e39c5709d7"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.231124  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.253032  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.254472  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.256217  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.258836  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.259223  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:15:21.259507  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.259707  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.305965  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.195:41245
I20260709 12:15:21.306094  8430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.195:41245 every 8 connection(s)
I20260709 12:15:21.311256  3211 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.319298  8434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.320269  8435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.323463  3211 server_base.cc:1061] running on GCE node
W20260709 12:15:21.323619  8437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.324836  3211 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:21.324990  8431 heartbeater.cc:344] Connected to a master server at 127.3.34.254:33989
W20260709 12:15:21.325150  3211 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.325381  3211 hybrid_clock.cc:648] HybridClock initialized: now 1783599321325363 us; error 0 us; skew 500 ppm
I20260709 12:15:21.325460  8431 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:21.326207  3211 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.326514  8431 heartbeater.cc:507] Master 127.3.34.254:33989 requested a full tablet report, sending...
I20260709 12:15:21.328967  3211 webserver.cc:533] Webserver started at http://127.3.34.196:43461/ using document root <none> and password file <none>
I20260709 12:15:21.329345  8155 ts_manager.cc:194] Registered new tserver with Master: b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:21.329692  3211 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.329993  3211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.330327  3211 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.331348  8155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37620
I20260709 12:15:21.331938  3211 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-3-root/instance:
uuid: "35617b9c10ad4daa80878f0de881422c"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.337251  3211 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:21.341189  8442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.342152  3211 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:15:21.342509  3211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
uuid: "35617b9c10ad4daa80878f0de881422c"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-x5d7"
I20260709 12:15:21.342839  3211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrWdwER/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599114140998-3211-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.352775  3211 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.354218  3211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.355868  3211 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.358144  3211 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.358382  3211 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.358644  3211 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.358835  3211 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.402237  3211 rpc_server.cc:307] RPC server started. Bound to: 127.3.34.196:42085
I20260709 12:15:21.402362  8504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.34.196:42085 every 8 connection(s)
I20260709 12:15:21.417315  8505 heartbeater.cc:344] Connected to a master server at 127.3.34.254:33989
I20260709 12:15:21.417814  8505 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:21.418622  8505 heartbeater.cc:507] Master 127.3.34.254:33989 requested a full tablet report, sending...
I20260709 12:15:21.420739  8155 ts_manager.cc:194] Registered new tserver with Master: 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:21.421181  3211 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015374747s
I20260709 12:15:21.422454  8155 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37634
I20260709 12:15:21.450270  8155 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37646:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:15:21.704617  8470 tablet_service.cc:1511] Processing CreateTablet for tablet 416f9094abe24cb79ae383453f8b221e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:21.706255  8470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416f9094abe24cb79ae383453f8b221e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.706579  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 416f9094abe24cb79ae383453f8b221e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:21.708063  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416f9094abe24cb79ae383453f8b221e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.710958  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 000cbbc93f224c7abbc8fc7d61b4e191 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:21.712548  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000cbbc93f224c7abbc8fc7d61b4e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.713166  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 61fe6595501f4c619d61dedd4c8eb8b5 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:21.714624  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fe6595501f4c619d61dedd4c8eb8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.718545  8245 tablet_service.cc:1511] Processing CreateTablet for tablet 61fe6595501f4c619d61dedd4c8eb8b5 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:21.719334  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c9e336d64e36988aa8af9b916076 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:21.720167  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fe6595501f4c619d61dedd4c8eb8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.721485  8468 tablet_service.cc:1511] Processing CreateTablet for tablet df3888d0746f41bbbf7b6e82062d3e08 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:21.723047  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3888d0746f41bbbf7b6e82062d3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.725315  8243 tablet_service.cc:1511] Processing CreateTablet for tablet e17a45545cc34a9ca0576c94ee626ccc (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:21.728915  8242 tablet_service.cc:1511] Processing CreateTablet for tablet 9e104b0cfb404501a9910825b4ee355c (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:21.725847  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c9e336d64e36988aa8af9b916076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.733139  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a45545cc34a9ca0576c94ee626ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.734611  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e104b0cfb404501a9910825b4ee355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.742069  8396 tablet_service.cc:1511] Processing CreateTablet for tablet 000cbbc93f224c7abbc8fc7d61b4e191 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:21.744220  8396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000cbbc93f224c7abbc8fc7d61b4e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.752492  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 61fe6595501f4c619d61dedd4c8eb8b5 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:15:21.754493  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fe6595501f4c619d61dedd4c8eb8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.759114  8394 tablet_service.cc:1511] Processing CreateTablet for tablet df3888d0746f41bbbf7b6e82062d3e08 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:21.761068  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3888d0746f41bbbf7b6e82062d3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.773134  8322 tablet_service.cc:1511] Processing CreateTablet for tablet 416f9094abe24cb79ae383453f8b221e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:15:21.774932  8466 tablet_service.cc:1511] Processing CreateTablet for tablet 9e104b0cfb404501a9910825b4ee355c (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:21.776441  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e104b0cfb404501a9910825b4ee355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.776309  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 000cbbc93f224c7abbc8fc7d61b4e191 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:15:21.779176  8320 tablet_service.cc:1511] Processing CreateTablet for tablet df3888d0746f41bbbf7b6e82062d3e08 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:15:21.773134  8467 tablet_service.cc:1511] Processing CreateTablet for tablet e17a45545cc34a9ca0576c94ee626ccc (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:21.782771  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a45545cc34a9ca0576c94ee626ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.774798  8322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416f9094abe24cb79ae383453f8b221e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.785365  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000cbbc93f224c7abbc8fc7d61b4e191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.786840  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3888d0746f41bbbf7b6e82062d3e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.789024  8465 tablet_service.cc:1511] Processing CreateTablet for tablet 305168f939834ee1886baf53318790a2 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:21.790896  8465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305168f939834ee1886baf53318790a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.823746  8464 tablet_service.cc:1511] Processing CreateTablet for tablet d488d21a9387402aa540f068f237a295 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:21.825362  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d488d21a9387402aa540f068f237a295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.829358  8318 tablet_service.cc:1511] Processing CreateTablet for tablet e17a45545cc34a9ca0576c94ee626ccc (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:15:21.831889  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 300320f772ad478099f8979d4543de23 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:21.834393  8315 tablet_service.cc:1511] Processing CreateTablet for tablet d488d21a9387402aa540f068f237a295 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:21.835970  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 305168f939834ee1886baf53318790a2 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:21.836078  8314 tablet_service.cc:1511] Processing CreateTablet for tablet d75f6416846c431394d73267f34045a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:21.824503  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c9e336d64e36988aa8af9b916076 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:21.837214  8463 tablet_service.cc:1511] Processing CreateTablet for tablet f0eeb9a483c44c6394dbf7aa57e178a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:21.838618  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eeb9a483c44c6394dbf7aa57e178a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.830904  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e17a45545cc34a9ca0576c94ee626ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.843096  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c9e336d64e36988aa8af9b916076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.845954  8313 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d306897264222a2d589b45d592dce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:21.847317  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d488d21a9387402aa540f068f237a295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.848260  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d306897264222a2d589b45d592dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.849056  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75f6416846c431394d73267f34045a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.849599  8462 tablet_service.cc:1511] Processing CreateTablet for tablet d75f6416846c431394d73267f34045a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:21.851136  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75f6416846c431394d73267f34045a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.855525  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300320f772ad478099f8979d4543de23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.859392  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305168f939834ee1886baf53318790a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.864935  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab2c9e336d64e36988aa8af9b916076 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:15:21.866557  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab2c9e336d64e36988aa8af9b916076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.872859  8392 tablet_service.cc:1511] Processing CreateTablet for tablet 9e104b0cfb404501a9910825b4ee355c (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:15:21.874418  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e104b0cfb404501a9910825b4ee355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.880821  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 305168f939834ee1886baf53318790a2 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:15:21.882397  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305168f939834ee1886baf53318790a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.884267  8390 tablet_service.cc:1511] Processing CreateTablet for tablet 300320f772ad478099f8979d4543de23 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:21.885813  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300320f772ad478099f8979d4543de23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:21.886348  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:21.888185  8389 tablet_service.cc:1511] Processing CreateTablet for tablet f0eeb9a483c44c6394dbf7aa57e178a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:21.889562  8389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eeb9a483c44c6394dbf7aa57e178a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.892247  8388 tablet_service.cc:1511] Processing CreateTablet for tablet d75f6416846c431394d73267f34045a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:15:21.893818  8388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75f6416846c431394d73267f34045a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.896284  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d306897264222a2d589b45d592dce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:21.898293  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d306897264222a2d589b45d592dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.908582  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 300320f772ad478099f8979d4543de23 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:15:21.909528  8241 tablet_service.cc:1511] Processing CreateTablet for tablet d488d21a9387402aa540f068f237a295 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:15:21.910162  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 300320f772ad478099f8979d4543de23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.912485  8240 tablet_service.cc:1511] Processing CreateTablet for tablet f0eeb9a483c44c6394dbf7aa57e178a3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:15:21.915589  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d306897264222a2d589b45d592dce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:15:21.918779  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 438aca5a484b480e8aa3600500c15d5f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:21.920739  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d488d21a9387402aa540f068f237a295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.925686  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eeb9a483c44c6394dbf7aa57e178a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.931663  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d306897264222a2d589b45d592dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.939580  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438aca5a484b480e8aa3600500c15d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.974311  8240 tablet_service.cc:1511] Processing CreateTablet for tablet bedb2c9a19ab4ffbac05001cfcb9bf84 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:21.975821  8240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedb2c9a19ab4ffbac05001cfcb9bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.981240  8313 tablet_service.cc:1511] Processing CreateTablet for tablet 438aca5a484b480e8aa3600500c15d5f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:21.982620  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438aca5a484b480e8aa3600500c15d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.005422  8526 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:22.009049  8461 tablet_service.cc:1511] Processing CreateTablet for tablet 438aca5a484b480e8aa3600500c15d5f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:15:22.010691  8461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438aca5a484b480e8aa3600500c15d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.025712  8525 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:22.026093  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:22.067569  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.054791  8391 tablet_service.cc:1511] Processing CreateTablet for tablet bedb2c9a19ab4ffbac05001cfcb9bf84 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:22.072763  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedb2c9a19ab4ffbac05001cfcb9bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.077852  8527 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:22.054450  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 7f44f2df1a8f4503828d8b04a53f6b95 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:22.081996  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f44f2df1a8f4503828d8b04a53f6b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.095297  8525 tablet_bootstrap.cc:654] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.105942  8468 tablet_service.cc:1511] Processing CreateTablet for tablet bedb2c9a19ab4ffbac05001cfcb9bf84 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:15:22.129513  8282 heartbeater.cc:499] Master 127.3.34.254:33989 was elected leader, sending a full tablet report...
I20260709 12:15:22.109655  8388 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:22.132122  8388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.132790  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 7f44f2df1a8f4503828d8b04a53f6b95 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:22.133898  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 7f44f2df1a8f4503828d8b04a53f6b95 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:15:22.137023  8528 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:22.153816  8239 tablet_service.cc:1511] Processing CreateTablet for tablet 5925c1429975480998dca9d5db37b825 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:22.155272  8239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5925c1429975480998dca9d5db37b825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.138258  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f44f2df1a8f4503828d8b04a53f6b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.143018  8527 tablet_bootstrap.cc:654] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.179807  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedb2c9a19ab4ffbac05001cfcb9bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.182667  8390 tablet_service.cc:1511] Processing CreateTablet for tablet 31de02a86b3d49d1af63827598c1a76a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:22.184136  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de02a86b3d49d1af63827598c1a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.186698  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f44f2df1a8f4503828d8b04a53f6b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.232273  8357 heartbeater.cc:499] Master 127.3.34.254:33989 was elected leader, sending a full tablet report...
I20260709 12:15:22.236063  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 31de02a86b3d49d1af63827598c1a76a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:22.237761  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de02a86b3d49d1af63827598c1a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.242080  8526 tablet_bootstrap.cc:654] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.255827  8462 tablet_service.cc:1511] Processing CreateTablet for tablet 31de02a86b3d49d1af63827598c1a76a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:15:22.257467  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31de02a86b3d49d1af63827598c1a76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.262250  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 5925c1429975480998dca9d5db37b825 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:22.263878  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5925c1429975480998dca9d5db37b825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.267905  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:15:22.269431  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ee06e6e6314c8f9f8c9ccfe13589a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.243396  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 5925c1429975480998dca9d5db37b825 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:15:22.272682  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5925c1429975480998dca9d5db37b825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.289089  8525 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:22.289733  8525 ts_tablet_manager.cc:1403] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.264s	user 0.007s	sys 0.009s
I20260709 12:15:22.290673  8528 tablet_bootstrap.cc:654] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.293576  8525 raft_consensus.cc:359] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.294381  8525 raft_consensus.cc:385] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.294685  8525 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.294693  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 32248472abc44c9bba02ee8e40ec7475 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:22.305318  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32248472abc44c9bba02ee8e40ec7475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.309571  8527 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:22.310184  8527 ts_tablet_manager.cc:1403] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.233s	user 0.006s	sys 0.046s
I20260709 12:15:22.314823  8527 raft_consensus.cc:359] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.315675  8527 raft_consensus.cc:385] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.316010  8527 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.316830  8527 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.329128  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 32248472abc44c9bba02ee8e40ec7475 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:22.330662  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32248472abc44c9bba02ee8e40ec7475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.334947  8431 heartbeater.cc:499] Master 127.3.34.254:33989 was elected leader, sending a full tablet report...
I20260709 12:15:22.348088  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 32248472abc44c9bba02ee8e40ec7475 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:15:22.349553  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32248472abc44c9bba02ee8e40ec7475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.365801  8528 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:22.366394  8528 ts_tablet_manager.cc:1403] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.000s
I20260709 12:15:22.369607  8528 raft_consensus.cc:359] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.370425  8528 raft_consensus.cc:385] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.393519  8528 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.393829  8464 tablet_service.cc:1511] Processing CreateTablet for tablet ea8792e9c5a048e987bab09333071e2e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:22.394573  8528 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.385017  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 1928b0c529924067acf1990936762a6e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:22.382296  8525 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.396186  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1928b0c529924067acf1990936762a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.387485  8315 tablet_service.cc:1511] Processing CreateTablet for tablet 1928b0c529924067acf1990936762a6e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:22.393122  8527 ts_tablet_manager.cc:1434] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.083s	user 0.020s	sys 0.059s
I20260709 12:15:22.395195  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8792e9c5a048e987bab09333071e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.389842  8390 tablet_service.cc:1511] Processing CreateTablet for tablet 1928b0c529924067acf1990936762a6e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:15:22.399183  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1928b0c529924067acf1990936762a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.402125  8527 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:22.410470  8526 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:22.411196  8526 ts_tablet_manager.cc:1403] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.504s	user 0.014s	sys 0.019s
I20260709 12:15:22.414425  8526 raft_consensus.cc:359] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.415261  8526 raft_consensus.cc:385] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.415479  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1928b0c529924067acf1990936762a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.415625  8526 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.416823  8526 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.424154  8528 ts_tablet_manager.cc:1434] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:15:22.425426  8528 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:22.425633  8505 heartbeater.cc:499] Master 127.3.34.254:33989 was elected leader, sending a full tablet report...
I20260709 12:15:22.427376  8241 tablet_service.cc:1511] Processing CreateTablet for tablet ea8792e9c5a048e987bab09333071e2e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:22.443360  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8792e9c5a048e987bab09333071e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.447731  8527 tablet_bootstrap.cc:654] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.453308  8321 tablet_service.cc:1511] Processing CreateTablet for tablet ea8792e9c5a048e987bab09333071e2e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:15:22.463820  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8792e9c5a048e987bab09333071e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.466632  8528 tablet_bootstrap.cc:654] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.473198  8525 ts_tablet_manager.cc:1434] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.182s	user 0.011s	sys 0.006s
I20260709 12:15:22.476069  8525 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:22.485055  8526 ts_tablet_manager.cc:1434] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.073s	user 0.023s	sys 0.014s
I20260709 12:15:22.491066  8526 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:22.490671  8390 tablet_service.cc:1511] Processing CreateTablet for tablet c9125ef7208a4120bf84f3925d5d4521 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:22.495064  8463 tablet_service.cc:1511] Processing CreateTablet for tablet c9125ef7208a4120bf84f3925d5d4521 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:22.500782  8244 tablet_service.cc:1511] Processing CreateTablet for tablet c9125ef7208a4120bf84f3925d5d4521 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:15:22.502161  8526 tablet_bootstrap.cc:654] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.516884  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9125ef7208a4120bf84f3925d5d4521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.503491  8314 tablet_service.cc:1511] Processing CreateTablet for tablet d77fccb2892a48378d8e5ae26eba6096 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:22.504515  8387 tablet_service.cc:1511] Processing CreateTablet for tablet d77fccb2892a48378d8e5ae26eba6096 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:22.520918  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77fccb2892a48378d8e5ae26eba6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.507778  8527 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:22.522110  8527 ts_tablet_manager.cc:1403] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.003s
I20260709 12:15:22.508777  8532 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.525069  8396 tablet_service.cc:1511] Processing CreateTablet for tablet 6f757a1a65af43d8b4c8996f392e3bfd (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:22.512117  8464 tablet_service.cc:1511] Processing CreateTablet for tablet d77fccb2892a48378d8e5ae26eba6096 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:15:22.525594  8532 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.526288  8247 tablet_service.cc:1511] Processing CreateTablet for tablet ae4f4f07bd32437a98ac789ece17a21b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:22.526849  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77fccb2892a48378d8e5ae26eba6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.523543  8468 tablet_service.cc:1511] Processing CreateTablet for tablet ae4f4f07bd32437a98ac789ece17a21b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:22.528793  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4f4f07bd32437a98ac789ece17a21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.529685  8532 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:22.508200  8525 tablet_bootstrap.cc:654] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.515319  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 6f757a1a65af43d8b4c8996f392e3bfd (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:15:22.523540  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9125ef7208a4120bf84f3925d5d4521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.513708  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 6f757a1a65af43d8b4c8996f392e3bfd (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 12:15:22.561259  8432 tablet.cc:2406] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:22.566133  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4f4f07bd32437a98ac789ece17a21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.566380  8528 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:22.568774  8528 ts_tablet_manager.cc:1403] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.144s	user 0.003s	sys 0.027s
I20260709 12:15:22.567425  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77fccb2892a48378d8e5ae26eba6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.567648  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f757a1a65af43d8b4c8996f392e3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.567306  8536 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.572050  8321 tablet_service.cc:1511] Processing CreateTablet for tablet ae4f4f07bd32437a98ac789ece17a21b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:15:22.571874  8536 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.573455  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4f4f07bd32437a98ac789ece17a21b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.566304  8526 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:22.592852  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9125ef7208a4120bf84f3925d5d4521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.596122  8526 ts_tablet_manager.cc:1403] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.110s	user 0.024s	sys 0.006s
I20260709 12:15:22.597944  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f757a1a65af43d8b4c8996f392e3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.618160  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde30635c7f45dead7584c98d2d807d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:22.618498  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde30635c7f45dead7584c98d2d807d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:22.619601  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde30635c7f45dead7584c98d2d807d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.620234  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde30635c7f45dead7584c98d2d807d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.603822  8536 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:22.626511  8526 raft_consensus.cc:359] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.618598  8528 raft_consensus.cc:359] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.627374  8526 raft_consensus.cc:385] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.627538  8528 raft_consensus.cc:385] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.627780  8526 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.627907  8528 raft_consensus.cc:740] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.628751  8526 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.629091  8528 consensus_queue.cc:260] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.615868  8396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f757a1a65af43d8b4c8996f392e3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.640148  8528 ts_tablet_manager.cc:1434] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:15:22.641597  8528 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:22.600318  8527 raft_consensus.cc:359] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.668601  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde30635c7f45dead7584c98d2d807d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:15:22.670184  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde30635c7f45dead7584c98d2d807d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.672250  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8f3d635a3b46938c2710e672edf79d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:22.673745  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8f3d635a3b46938c2710e672edf79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.681171  8462 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8f3d635a3b46938c2710e672edf79d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:22.682566  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8f3d635a3b46938c2710e672edf79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.688489  8525 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:22.689286  8525 ts_tablet_manager.cc:1403] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.010s
I20260709 12:15:22.675479  8527 raft_consensus.cc:385] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.695458  8527 raft_consensus.cc:740] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.696579  8527 consensus_queue.cc:260] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.706384  8535 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.707078  8535 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:22.710250  8535 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:22.717252  8525 raft_consensus.cc:359] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:22.717926  8525 raft_consensus.cc:385] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.718158  8525 raft_consensus.cc:740] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.721217  8526 ts_tablet_manager.cc:1434] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.001s
I20260709 12:15:22.722450  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:22.724761  8527 ts_tablet_manager.cc:1434] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.193s	user 0.009s	sys 0.001s
W20260709 12:15:22.733145  8370 leader_election.cc:343] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.735288  8394 tablet_service.cc:1511] Processing CreateTablet for tablet dbbdda706773489c8f1e9db5d6e9254d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:22.736680  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbdda706773489c8f1e9db5d6e9254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.743335  8528 tablet_bootstrap.cc:654] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.722513  8526 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:22.681171  8244 tablet_service.cc:1511] Processing CreateTablet for tablet dbbdda706773489c8f1e9db5d6e9254d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:22.718791  8525 consensus_queue.cc:260] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:22.754599  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 6da618d8bd7a4d3dbf914c3a6af98081 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:22.748668  8527 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:22.761727  8534 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.762501  8534 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:22.765893  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da618d8bd7a4d3dbf914c3a6af98081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.768872  8534 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:22.775413  8525 ts_tablet_manager.cc:1434] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 12:15:22.789129  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbdda706773489c8f1e9db5d6e9254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.809563  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8f3d635a3b46938c2710e672edf79d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:15:22.810942  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8f3d635a3b46938c2710e672edf79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.815157  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 6da618d8bd7a4d3dbf914c3a6af98081 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:22.816574  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da618d8bd7a4d3dbf914c3a6af98081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.837087  8396 tablet_service.cc:1511] Processing CreateTablet for tablet 6aec989e68ad45a3b8540a35920b4b4e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:22.840554  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 6da618d8bd7a4d3dbf914c3a6af98081 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:15:22.841466  8396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aec989e68ad45a3b8540a35920b4b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.842023  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da618d8bd7a4d3dbf914c3a6af98081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.838721  8314 tablet_service.cc:1511] Processing CreateTablet for tablet dbbdda706773489c8f1e9db5d6e9254d (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:15:22.843932  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbdda706773489c8f1e9db5d6e9254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.855579  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:22.879000  8525 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:22.885732  8526 tablet_bootstrap.cc:654] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:22.889153  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:22.902081  8297 leader_election.cc:343] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.906332  8315 tablet_service.cc:1511] Processing CreateTablet for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:22.907796  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.912140  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 6aec989e68ad45a3b8540a35920b4b4e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:22.912694  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:22.913763  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aec989e68ad45a3b8540a35920b4b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.914481  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:22.927007  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:22.928550  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:22.929025  8221 leader_election.cc:343] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:22.930444  8446 leader_election.cc:343] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.934345  8464 tablet_service.cc:1511] Processing CreateTablet for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:22.936043  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:22.938438  8372 leader_election.cc:343] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.938711  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 28270200f56944ca899873c119f8ae9b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:22.940275  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28270200f56944ca899873c119f8ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.939043  8372 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:22.943583  8527 tablet_bootstrap.cc:654] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.944025  8532 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:22.944729  8528 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:22.945287  8528 ts_tablet_manager.cc:1403] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.304s	user 0.028s	sys 0.026s
I20260709 12:15:22.950110  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 28270200f56944ca899873c119f8ae9b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:22.951628  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28270200f56944ca899873c119f8ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:22.951719  8298 leader_election.cc:343] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.952293  8298 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:22.953624  8536 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:22.956149  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 6aec989e68ad45a3b8540a35920b4b4e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:15:22.957547  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aec989e68ad45a3b8540a35920b4b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.957669  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 28270200f56944ca899873c119f8ae9b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:15:22.959025  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28270200f56944ca899873c119f8ae9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.962455  8525 tablet_bootstrap.cc:654] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.932451  8387 tablet_service.cc:1511] Processing CreateTablet for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:15:22.971503  8536 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.972047  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 028c831fc6fe4bc3a5dacb16c136884b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:22.972147  8536 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:22.973647  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028c831fc6fe4bc3a5dacb16c136884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.976677  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:22.978506  8297 leader_election.cc:343] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.979278  8536 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:22.980774  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:22.982120  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aebbe34acf2b4c6dbeb80e89dd1d5fc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:22.982288  8298 leader_election.cc:343] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.982820  8298 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:22.984014  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:22.984977  8536 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:22.985538  8445 leader_election.cc:343] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.986639  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:22.989921  8534 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:22.999464  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 028c831fc6fe4bc3a5dacb16c136884b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:22.999789  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 028c831fc6fe4bc3a5dacb16c136884b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:15:23.001917  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028c831fc6fe4bc3a5dacb16c136884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.005198  8528 raft_consensus.cc:359] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.002020  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028c831fc6fe4bc3a5dacb16c136884b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.015569  8526 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:23.016002  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.010314  8528 raft_consensus.cc:385] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.016323  8526 ts_tablet_manager.cc:1403] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.294s	user 0.013s	sys 0.008s
W20260709 12:15:23.017833  8220 leader_election.cc:343] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.018339  8220 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:23.018698  8394 tablet_service.cc:1511] Processing CreateTablet for tablet faea1550226d4b32b5e0955096972f73 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:23.019614  8535 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.021096  8526 raft_consensus.cc:359] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.026079  8526 raft_consensus.cc:385] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.026479  8526 raft_consensus.cc:740] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.021874  8528 raft_consensus.cc:740] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.027799  8528 consensus_queue.cc:260] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.022281  8468 tablet_service.cc:1511] Processing CreateTablet for tablet faea1550226d4b32b5e0955096972f73 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:23.030638  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea1550226d4b32b5e0955096972f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.033429  8526 consensus_queue.cc:260] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.028415  8244 tablet_service.cc:1511] Processing CreateTablet for tablet faea1550226d4b32b5e0955096972f73 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:15:23.040062  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea1550226d4b32b5e0955096972f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.024099  8527 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:23.043485  8527 ts_tablet_manager.cc:1403] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.318s	user 0.012s	sys 0.006s
I20260709 12:15:23.036902  8525 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:23.025494  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faea1550226d4b32b5e0955096972f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.038843  8528 ts_tablet_manager.cc:1434] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260709 12:15:23.049160  8526 ts_tablet_manager.cc:1434] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:15:23.048593  8534 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.046765  8527 raft_consensus.cc:359] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.055158  8534 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.057317  8525 ts_tablet_manager.cc:1403] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.240s	user 0.020s	sys 0.001s
I20260709 12:15:23.055569  8527 raft_consensus.cc:385] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.060514  8527 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.061872  8534 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.063086  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.064404  8526 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
W20260709 12:15:23.064697  8445 leader_election.cc:343] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.066704  8528 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.062551  8527 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.072956  8526 tablet_bootstrap.cc:654] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.073854  8527 ts_tablet_manager.cc:1434] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:15:23.078500  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 32666a4a15904513a3c010c3fa185950 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:23.080596  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 32666a4a15904513a3c010c3fa185950 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:23.088143  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32666a4a15904513a3c010c3fa185950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.082798  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 32666a4a15904513a3c010c3fa185950 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:15:23.088143  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32666a4a15904513a3c010c3fa185950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.091827  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32666a4a15904513a3c010c3fa185950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.092703  8525 raft_consensus.cc:359] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.086308  8526 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:23.099699  8525 raft_consensus.cc:385] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.100109  8526 ts_tablet_manager.cc:1403] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.007s
I20260709 12:15:23.100167  8525 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.099032  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:23.103067  8443 leader_election.cc:343] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.103595  8443 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.104487  8534 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.105620  8526 raft_consensus.cc:359] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.106516  8526 raft_consensus.cc:385] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.107002  8526 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.101682  8525 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.110810  8528 tablet_bootstrap.cc:654] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.112571  8315 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6df51ca3f54a65a96f425ead4beeb7 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:23.114044  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6df51ca3f54a65a96f425ead4beeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.116838  8532 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.117424  8532 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.108104  8526 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.123169  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:23.127641  8370 leader_election.cc:343] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.128366  8532 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.129498  8525 ts_tablet_manager.cc:1434] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.004s
I20260709 12:15:23.130568  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6df51ca3f54a65a96f425ead4beeb7 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:23.132203  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6df51ca3f54a65a96f425ead4beeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.109978  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6df51ca3f54a65a96f425ead4beeb7 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:15:23.135408  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6df51ca3f54a65a96f425ead4beeb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.137249  8526 ts_tablet_manager.cc:1434] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:15:23.141273  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.141566  8525 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
W20260709 12:15:23.143183  8369 leader_election.cc:343] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.143716  8369 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:23.145161  8532 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.148716  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 190df87128654922bd7944b9cbb1ae3b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:23.152005  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190df87128654922bd7944b9cbb1ae3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.151726  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 190df87128654922bd7944b9cbb1ae3b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:23.153335  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190df87128654922bd7944b9cbb1ae3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.149735  8526 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:23.153635  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 190df87128654922bd7944b9cbb1ae3b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:15:23.155207  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190df87128654922bd7944b9cbb1ae3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.088174  8527 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:23.167718  8528 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:23.167629  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 830be490ae644f67b4bf87248e3bb615 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:23.168568  8528 ts_tablet_manager.cc:1403] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.102s	user 0.026s	sys 0.001s
I20260709 12:15:23.169308  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830be490ae644f67b4bf87248e3bb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.168872  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 830be490ae644f67b4bf87248e3bb615 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:23.171908  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830be490ae644f67b4bf87248e3bb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.172222  8528 raft_consensus.cc:359] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.173063  8528 raft_consensus.cc:385] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.173413  8528 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.174429  8535 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.175004  8535 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.180230  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.180944  8332 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:23.182060  8526 tablet_bootstrap.cc:654] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.183198  8535 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:23.183656  8238 tablet_service.cc:1511] Processing CreateTablet for tablet 830be490ae644f67b4bf87248e3bb615 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:15:23.184758  8534 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.184847  8314 tablet_service.cc:1511] Processing CreateTablet for tablet e42ccdb3fbee4edcb15e2a892b920759 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:23.192322  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830be490ae644f67b4bf87248e3bb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.194070  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42ccdb3fbee4edcb15e2a892b920759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.196115  8321 tablet_service.cc:1511] Processing CreateTablet for tablet d66cbe0fda224c11a64b3afe9df50f1e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:23.197553  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66cbe0fda224c11a64b3afe9df50f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.190657  8534 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.191323  8528 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.200474  8241 tablet_service.cc:1511] Processing CreateTablet for tablet d66cbe0fda224c11a64b3afe9df50f1e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:23.202016  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66cbe0fda224c11a64b3afe9df50f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.188120  8220 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:23.203758  8535 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.204242  8535 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.204694  8535 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.207683  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.209290  8469 tablet_service.cc:1511] Processing CreateTablet for tablet e42ccdb3fbee4edcb15e2a892b920759 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:15:23.210130  8222 leader_election.cc:343] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.211784  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42ccdb3fbee4edcb15e2a892b920759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.214382  8534 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:23.211998  8394 tablet_service.cc:1511] Processing CreateTablet for tablet e42ccdb3fbee4edcb15e2a892b920759 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:15:23.217178  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42ccdb3fbee4edcb15e2a892b920759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.217046  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:23.219664  8446 leader_election.cc:343] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.218604  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:23.221674  8445 leader_election.cc:343] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.222191  8445 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.223481  8534 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.222972  8525 tablet_bootstrap.cc:654] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.243822  8532 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.244481  8532 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.248589  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:23.250368  8372 leader_election.cc:343] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.251173  8532 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:23.255296  8387 tablet_service.cc:1511] Processing CreateTablet for tablet d66cbe0fda224c11a64b3afe9df50f1e (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:15:23.257386  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66cbe0fda224c11a64b3afe9df50f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.257810  8536 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.258386  8536 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.300021  8527 tablet_bootstrap.cc:654] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.252919  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.303844  8332 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:23.305649  8369 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:23.306963  8532 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.307435  8532 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.307144  8469 tablet_service.cc:1511] Processing CreateTablet for tablet cff9ab56f09c438293e24be61ae38fb3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:23.307832  8532 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.308585  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff9ab56f09c438293e24be61ae38fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.309736  8238 tablet_service.cc:1511] Processing CreateTablet for tablet cff9ab56f09c438293e24be61ae38fb3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:23.311156  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff9ab56f09c438293e24be61ae38fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.315829  8534 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.316402  8534 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.318676  8534 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.315462  8532 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.322263  8526 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:23.308853  8535 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.320267  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.323961  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:23.324385  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:23.325047  8331 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:23.325767  8372 leader_election.cc:343] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.326704  8526 ts_tablet_manager.cc:1403] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.177s	user 0.017s	sys 0.014s
I20260709 12:15:23.327409  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:23.329135  8222 leader_election.cc:343] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:23.327520  8445 leader_election.cc:343] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.330775  8535 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:23.332113  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:23.332085  8526 raft_consensus.cc:359] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.332954  8330 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.333139  8526 raft_consensus.cc:385] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.333899  8526 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.335548  8526 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.339529  8532 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:23.340586  8536 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.341951  8525 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:23.347260  8525 ts_tablet_manager.cc:1403] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.206s	user 0.034s	sys 0.021s
I20260709 12:15:23.342198  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:23.350335  8525 raft_consensus.cc:359] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.350747  8256 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:23.351162  8525 raft_consensus.cc:385] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.351521  8525 raft_consensus.cc:740] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.341253  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.352263  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:23.352228  8525 consensus_queue.cc:260] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.352732  8332 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:23.353832  8443 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.354754  8536 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.355186  8536 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.355541  8536 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.356650  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:23.356595  8526 ts_tablet_manager.cc:1434] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
W20260709 12:15:23.358330  8296 leader_election.cc:343] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.359050  8319 tablet_service.cc:1511] Processing CreateTablet for tablet cff9ab56f09c438293e24be61ae38fb3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:15:23.360886  8526 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:23.354698  8525 ts_tablet_manager.cc:1434] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:23.364023  8525 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:23.366937  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff9ab56f09c438293e24be61ae38fb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.372869  8536 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.342415  8330 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:23.342972  8528 ts_tablet_manager.cc:1434] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.174s	user 0.020s	sys 0.013s
I20260709 12:15:23.375351  8536 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.376009  8528 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.376469  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:23.378047  8296 leader_election.cc:343] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.378132  8561 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.378937  8561 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.355744  8331 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:23.379292  8220 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.383073  8394 tablet_service.cc:1511] Processing CreateTablet for tablet bbb3616518e54d0295c345f3153cf62b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:23.384502  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb3616518e54d0295c345f3153cf62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.384703  8469 tablet_service.cc:1511] Processing CreateTablet for tablet bbb3616518e54d0295c345f3153cf62b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:23.386027  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb3616518e54d0295c345f3153cf62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.386628  8535 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.379491  8561 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.389729  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:23.390422  8256 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.391076  8528 tablet_bootstrap.cc:654] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.376739  8525 tablet_bootstrap.cc:654] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.396849  8526 tablet_bootstrap.cc:654] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.399636  8369 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:23.401116  8532 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.401991  8256 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:23.412245  8535 raft_consensus.cc:697] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:23.416908  8535 consensus_queue.cc:237] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.419091  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:23.419337  8238 tablet_service.cc:1511] Processing CreateTablet for tablet bbb3616518e54d0295c345f3153cf62b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:15:23.420207  8564 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.420814  8564 raft_consensus.cc:697] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:23.422641  8564 consensus_queue.cc:237] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.424230  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed8246ac7e249fdae8fe1c01cba50f3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:23.432202  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed8246ac7e249fdae8fe1c01cba50f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.432379  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb3616518e54d0295c345f3153cf62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.432847  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 53cf6c47fc2b43f69bbc266d55353c9a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:23.434304  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cf6c47fc2b43f69bbc266d55353c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.429459  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed8246ac7e249fdae8fe1c01cba50f3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:23.430091  8532 raft_consensus.cc:697] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:23.447525  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed8246ac7e249fdae8fe1c01cba50f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.447834  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 53cf6c47fc2b43f69bbc266d55353c9a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:23.449354  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cf6c47fc2b43f69bbc266d55353c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.447324  8532 consensus_queue.cc:237] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.452529  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 53cf6c47fc2b43f69bbc266d55353c9a (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:15:23.453990  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53cf6c47fc2b43f69bbc266d55353c9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.455112  8152 catalog_manager.cc:5697] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.460567  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed8246ac7e249fdae8fe1c01cba50f3 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:15:23.462581  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed8246ac7e249fdae8fe1c01cba50f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.477190  8528 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:23.478091  8528 ts_tablet_manager.cc:1403] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.014s
I20260709 12:15:23.483385  8528 raft_consensus.cc:359] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.484970  8528 raft_consensus.cc:385] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.486871  8528 raft_consensus.cc:740] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.487831  8528 consensus_queue.cc:260] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.489382  8469 tablet_service.cc:1511] Processing CreateTablet for tablet cc19f18db497464596bb5dba990be7ce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:23.490761  8528 ts_tablet_manager.cc:1434] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:15:23.499833  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc19f18db497464596bb5dba990be7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.517479  8566 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.518093  8566 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.520598  8566 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.522373  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:23.523217  8480 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:23.524399  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:23.526016  8222 leader_election.cc:343] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.527376  8525 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:23.527217  8221 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.527982  8525 ts_tablet_manager.cc:1403] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.013s
I20260709 12:15:23.528419  8566 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.502144  8561 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.537465  8241 tablet_service.cc:1511] Processing CreateTablet for tablet cc19f18db497464596bb5dba990be7ce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:23.539759  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc19f18db497464596bb5dba990be7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.548655  8319 tablet_service.cc:1511] Processing CreateTablet for tablet cc19f18db497464596bb5dba990be7ce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:15:23.531206  8566 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.550895  8566 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.550912  8154 catalog_manager.cc:5697] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.537933  8525 raft_consensus.cc:359] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.553668  8525 raft_consensus.cc:385] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.557202  8526 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:23.562876  8525 raft_consensus.cc:740] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.561287  8561 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.561460  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:23.562283  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:23.563596  8527 tablet_bootstrap.cc:492] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:23.563862  8331 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.564170  8527 ts_tablet_manager.cc:1403] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.476s	user 0.019s	sys 0.012s
W20260709 12:15:23.565093  8445 leader_election.cc:343] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.566334  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc19f18db497464596bb5dba990be7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.568002  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 28b049654a98498cb575cc50eb45a7f9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:23.567225  8525 consensus_queue.cc:260] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.571156  8331 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:23.571856  8528 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.563292  8526 ts_tablet_manager.cc:1403] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.203s	user 0.012s	sys 0.012s
I20260709 12:15:23.575331  8443 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.576359  8534 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.576673  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b049654a98498cb575cc50eb45a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.582047  8528 tablet_bootstrap.cc:654] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.581600  8527 raft_consensus.cc:359] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.585157  8527 raft_consensus.cc:385] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.584928  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 28b049654a98498cb575cc50eb45a7f9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:23.586416  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b049654a98498cb575cc50eb45a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.591714  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 28b049654a98498cb575cc50eb45a7f9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:15:23.593070  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28b049654a98498cb575cc50eb45a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.588491  8527 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.594604  8526 raft_consensus.cc:359] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.602296  8534 raft_consensus.cc:697] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:23.604089  8534 consensus_queue.cc:237] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.602751  8526 raft_consensus.cc:385] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.606382  8526 raft_consensus.cc:740] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.623230  8576 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.623934  8576 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.626086  8526 consensus_queue.cc:260] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.620477  8527 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.633491  8527 ts_tablet_manager.cc:1434] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.001s
I20260709 12:15:23.634757  8527 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:23.636557  8155 catalog_manager.cc:5697] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.640657  8387 tablet_service.cc:1511] Processing CreateTablet for tablet d10e178915634d25bc567779eda3fcce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:23.643601  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e178915634d25bc567779eda3fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.645641  8528 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:23.646199  8528 ts_tablet_manager.cc:1403] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.034s
I20260709 12:15:23.648569  8526 ts_tablet_manager.cc:1434] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:15:23.648418  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.649170  8331 raft_consensus.cc:2468] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:23.649668  8526 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:23.650771  8220 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:23.651561  8528 raft_consensus.cc:359] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.651750  8314 tablet_service.cc:1511] Processing CreateTablet for tablet d10e178915634d25bc567779eda3fcce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:23.652318  8528 raft_consensus.cc:385] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.652685  8528 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.653182  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e178915634d25bc567779eda3fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.653410  8528 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.654341  8535 raft_consensus.cc:2804] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.661902  8535 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.662446  8535 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.662551  8244 tablet_service.cc:1511] Processing CreateTablet for tablet fd5832a7f1874b879d2943248a7135fe (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:23.655980  8528 ts_tablet_manager.cc:1434] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:15:23.663985  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5832a7f1874b879d2943248a7135fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.668852  8469 tablet_service.cc:1511] Processing CreateTablet for tablet d10e178915634d25bc567779eda3fcce (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:15:23.669761  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e178915634d25bc567779eda3fcce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.665948  8566 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.671692  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.672003  8321 tablet_service.cc:1511] Processing CreateTablet for tablet fd5832a7f1874b879d2943248a7135fe (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:23.673456  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5832a7f1874b879d2943248a7135fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:23.674012  8222 leader_election.cc:343] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.675638  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:23.676443  8406 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.678524  8528 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.675784  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:23.679392  8480 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.683694  8577 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.685963  8528 tablet_bootstrap.cc:654] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.686054  8566 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.684516  8577 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.693288  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:23.694324  8577 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:23.694648  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:23.696231  8443 leader_election.cc:343] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:23.697391  8446 leader_election.cc:343] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.697834  8446 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:23.699116  8577 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.699211  8525 ts_tablet_manager.cc:1434] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.170s	user 0.009s	sys 0.006s
I20260709 12:15:23.667936  8576 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.700819  8525 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:23.703413  8387 tablet_service.cc:1511] Processing CreateTablet for tablet fd5832a7f1874b879d2943248a7135fe (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:15:23.704752  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5832a7f1874b879d2943248a7135fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.727480  8469 tablet_service.cc:1511] Processing CreateTablet for tablet dec01fc5fb0a43e6808551ad72c5d606 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:23.728505  8406 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:23.728780  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec01fc5fb0a43e6808551ad72c5d606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.731369  8527 tablet_bootstrap.cc:654] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.735387  8526 tablet_bootstrap.cc:654] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.734586  8153 catalog_manager.cc:5697] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.738963  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:23.740016  8576 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.740607  8576 raft_consensus.cc:697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:23.741703  8528 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:23.741528  8576 consensus_queue.cc:237] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.742293  8528 ts_tablet_manager.cc:1403] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.002s
I20260709 12:15:23.744956  8525 tablet_bootstrap.cc:654] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.757844  8241 tablet_service.cc:1511] Processing CreateTablet for tablet dec01fc5fb0a43e6808551ad72c5d606 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:23.758078  8535 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.759292  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec01fc5fb0a43e6808551ad72c5d606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.732874  8480 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:23.769268  8387 tablet_service.cc:1511] Processing CreateTablet for tablet d72e932c2eee4dd28f7f05aa582fcfb0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:23.770542  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72e932c2eee4dd28f7f05aa582fcfb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.765394  8528 raft_consensus.cc:359] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.772778  8528 raft_consensus.cc:385] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.773195  8528 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.773245  8469 tablet_service.cc:1511] Processing CreateTablet for tablet d72e932c2eee4dd28f7f05aa582fcfb0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:23.779583  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72e932c2eee4dd28f7f05aa582fcfb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.779902  8527 tablet_bootstrap.cc:492] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:23.785585  8527 ts_tablet_manager.cc:1403] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.151s	user 0.015s	sys 0.008s
I20260709 12:15:23.778204  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 23b9669b9bee44ffa43fecf53ed6ca9f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:23.781126  8319 tablet_service.cc:1511] Processing CreateTablet for tablet f7a74bd0d6094fc497a5fd124956f81b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:23.789346  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a74bd0d6094fc497a5fd124956f81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.781644  8244 tablet_service.cc:1511] Processing CreateTablet for tablet d72e932c2eee4dd28f7f05aa582fcfb0 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:15:23.791869  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72e932c2eee4dd28f7f05aa582fcfb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.780643  8238 tablet_service.cc:1511] Processing CreateTablet for tablet f7a74bd0d6094fc497a5fd124956f81b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:23.794106  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a74bd0d6094fc497a5fd124956f81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.799391  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b9669b9bee44ffa43fecf53ed6ca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.802284  8534 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.775750  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 23b9669b9bee44ffa43fecf53ed6ca9f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:23.774194  8528 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.802968  8534 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.804920  8528 ts_tablet_manager.cc:1434] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.006s
I20260709 12:15:23.805963  8528 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.807674  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:23.808365  8331 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.808830  8534 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.776811  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 23b9669b9bee44ffa43fecf53ed6ca9f (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:15:23.812300  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:23.812747  8528 tablet_bootstrap.cc:654] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:23.814273  8443 leader_election.cc:343] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.815718  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b9669b9bee44ffa43fecf53ed6ca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.816406  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.817011  8331 raft_consensus.cc:2468] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:23.817251  8406 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:23.818480  8220 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:23.818732  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b9669b9bee44ffa43fecf53ed6ca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.819406  8576 raft_consensus.cc:2804] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.819862  8576 raft_consensus.cc:697] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:23.820658  8576 consensus_queue.cc:237] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.820989  8321 tablet_service.cc:1511] Processing CreateTablet for tablet dec01fc5fb0a43e6808551ad72c5d606 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:15:23.822144  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec01fc5fb0a43e6808551ad72c5d606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.824224  8445 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:23.807323  8394 tablet_service.cc:1511] Processing CreateTablet for tablet f7a74bd0d6094fc497a5fd124956f81b (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:15:23.826640  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a74bd0d6094fc497a5fd124956f81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.833745  8534 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.834247  8534 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.834599  8534 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.835916  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:23.841532  8222 leader_election.cc:343] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.843596  8566 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.844098  8566 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.846226  8566 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:23.846843  8222 consensus_peers.cc:597] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.847929  8468 tablet_service.cc:1511] Processing CreateTablet for tablet cb2165d3c7a64aecb05f5e7a9223ecd8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:23.849282  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2165d3c7a64aecb05f5e7a9223ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.849462  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:23.851351  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:23.851550  8222 leader_election.cc:343] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.852023  8480 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:23.855577  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:23.859215  8566 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.859637  8566 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.860021  8566 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.862193  8528 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:23.862797  8528 ts_tablet_manager.cc:1403] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 12:15:23.865828  8528 raft_consensus.cc:359] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.883167  8528 raft_consensus.cc:385] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.887133  8528 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.888110  8528 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:23.890275  8528 ts_tablet_manager.cc:1434] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 12:15:23.871031  8526 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:23.891054  8526 ts_tablet_manager.cc:1403] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.242s	user 0.024s	sys 0.000s
I20260709 12:15:23.892016  8564 consensus_queue.cc:1048] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:23.892191  8155 catalog_manager.cc:5697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.894449  8526 raft_consensus.cc:359] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.895360  8526 raft_consensus.cc:385] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.895743  8526 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.896602  8526 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:23.882094  8525 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:23.839093  8535 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:23.897933  8525 ts_tablet_manager.cc:1403] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.197s	user 0.029s	sys 0.032s
W20260709 12:15:23.870054  8372 consensus_peers.cc:597] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 -> Peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Couldn't send request to peer 29d436e9d3d54fe599d9aa67d38fba03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.869403  8527 raft_consensus.cc:359] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.884868  8532 consensus_queue.cc:1048] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:23.899804  8527 raft_consensus.cc:385] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.900195  8527 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.901085  8527 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.904680  8527 ts_tablet_manager.cc:1434] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 12:15:23.906188  8527 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
W20260709 12:15:23.906215  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:23.921499  8566 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:23.925565  8296 consensus_peers.cc:597] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 -> Peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Couldn't send request to peer 35617b9c10ad4daa80878f0de881422c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.925979  8528 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:23.925321  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:23.927459  8222 leader_election.cc:343] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.935124  8534 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:23.936411  8527 tablet_bootstrap.cc:654] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.938271  8525 raft_consensus.cc:359] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:23.938796  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:23.984086  8525 raft_consensus.cc:385] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.942130  8526 ts_tablet_manager.cc:1434] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 12:15:23.972093  8566 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:23.950736  8527 tablet_bootstrap.cc:492] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:23.987252  8527 ts_tablet_manager.cc:1403] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.006s
I20260709 12:15:23.987588  8526 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:23.973107  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:23.973696  8321 tablet_service.cc:1511] Processing CreateTablet for tablet cb2165d3c7a64aecb05f5e7a9223ecd8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:23.989470  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2165d3c7a64aecb05f5e7a9223ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.945900  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:23.991429  8406 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.992277  8525 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.932752  8528 tablet_bootstrap.cc:654] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.938759  8244 tablet_service.cc:1511] Processing CreateTablet for tablet cb2165d3c7a64aecb05f5e7a9223ecd8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:15:23.993468  8319 tablet_service.cc:1511] Processing CreateTablet for tablet ab17d74d3fe844ee9def403591842530 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:23.994050  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2165d3c7a64aecb05f5e7a9223ecd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.994825  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab17d74d3fe844ee9def403591842530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.999969  8387 tablet_service.cc:1511] Processing CreateTablet for tablet ab17d74d3fe844ee9def403591842530 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:24.001188  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab17d74d3fe844ee9def403591842530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:23.969250  8153 catalog_manager.cc:5697] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.003211  8480 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.983330  8469 tablet_service.cc:1511] Processing CreateTablet for tablet 3344c86d5a404f19a609fac8030806a9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:23.953881  8534 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:24.007735  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3344c86d5a404f19a609fac8030806a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.009048  8238 tablet_service.cc:1511] Processing CreateTablet for tablet f19131ff5ec0499b93e228a1447e9a76 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:24.010337  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19131ff5ec0499b93e228a1447e9a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.010398  8526 tablet_bootstrap.cc:654] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.012180  8468 tablet_service.cc:1511] Processing CreateTablet for tablet ab17d74d3fe844ee9def403591842530 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:15:24.013495  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab17d74d3fe844ee9def403591842530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.016319  8525 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.018935  8525 ts_tablet_manager.cc:1434] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.000s
I20260709 12:15:24.020099  8525 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.031556  8406 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
W20260709 12:15:23.985409  8443 leader_election.cc:343] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:24.032322  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 46968.4us
I20260709 12:15:23.975139  8396 tablet_service.cc:1511] Processing CreateTablet for tablet 3344c86d5a404f19a609fac8030806a9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:24.031805  8528 tablet_bootstrap.cc:492] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.033356  8528 ts_tablet_manager.cc:1403] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.012s
I20260709 12:15:24.033700  8396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3344c86d5a404f19a609fac8030806a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.036445  8528 raft_consensus.cc:359] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.037250  8528 raft_consensus.cc:385] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.037547  8528 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.039013  8566 consensus_queue.cc:1048] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.038334  8528 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.041903  8314 tablet_service.cc:1511] Processing CreateTablet for tablet f19131ff5ec0499b93e228a1447e9a76 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:24.043236  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19131ff5ec0499b93e228a1447e9a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.046234  8394 tablet_service.cc:1511] Processing CreateTablet for tablet f19131ff5ec0499b93e228a1447e9a76 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:15:24.048010  8534 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.048597  8534 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.050972  8536 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.051592  8536 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.052050  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19131ff5ec0499b93e228a1447e9a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.052469  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:24.054347  8445 leader_election.cc:343] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.054690  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.055356  8577 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.055938  8577 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.056988  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.058197  8536 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:23.984736  8241 tablet_service.cc:1511] Processing CreateTablet for tablet 3344c86d5a404f19a609fac8030806a9 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:15:24.050932  8534 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:24.060020  8298 leader_election.cc:343] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.059993  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.061137  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.059953  8527 raft_consensus.cc:359] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.061863  8479 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:24.062260  8527 raft_consensus.cc:385] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:24.062417  8446 leader_election.cc:343] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.062754  8527 raft_consensus.cc:740] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.063247  8241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3344c86d5a404f19a609fac8030806a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.076579  8525 tablet_bootstrap.cc:654] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.077592  8526 tablet_bootstrap.cc:492] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.078218  8526 ts_tablet_manager.cc:1403] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.091s	user 0.005s	sys 0.009s
I20260709 12:15:24.079738  8445 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.081204  8534 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.081920  8534 raft_consensus.cc:697] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:24.082856  8534 consensus_queue.cc:237] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.084954  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbab756712a45979451545f2bc323f1 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:24.086347  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbab756712a45979451545f2bc323f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.093765  8526 raft_consensus.cc:359] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.094921  8526 raft_consensus.cc:385] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.095384  8526 raft_consensus.cc:740] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.107041  8526 consensus_queue.cc:260] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.111159  8526 ts_tablet_manager.cc:1434] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.004s
I20260709 12:15:24.112329  8526 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:24.113193  8319 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbab756712a45979451545f2bc323f1 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:24.114605  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbab756712a45979451545f2bc323f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.114820  8394 tablet_service.cc:1511] Processing CreateTablet for tablet af028603c5e74d4c8e598da3c03999d8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:24.116055  8464 tablet_service.cc:1511] Processing CreateTablet for tablet af028603c5e74d4c8e598da3c03999d8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:24.116828  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af028603c5e74d4c8e598da3c03999d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.117552  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af028603c5e74d4c8e598da3c03999d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.063735  8527 consensus_queue.cc:260] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.064463  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:24.065457  8443 leader_election.cc:343] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.163892  8443 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.066175  8296 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:24.066905  8528 ts_tablet_manager.cc:1434] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:15:24.067487  8577 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:24.170866  8536 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.171386  8536 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.171772  8536 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.069415  8462 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbab756712a45979451545f2bc323f1 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:15:24.176172  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbab756712a45979451545f2bc323f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.176842  8480 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.167222  8534 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.183128  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.174625  8405 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:24.184058  8566 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.183923  8238 tablet_service.cc:1511] Processing CreateTablet for tablet af028603c5e74d4c8e598da3c03999d8 (DEFAULT_TABLE table=test-workload [id=9f075ba3cf504d098f31310136dd3f3f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:15:24.184698  8566 raft_consensus.cc:697] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:24.185389  8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af028603c5e74d4c8e598da3c03999d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:24.185683  8566 consensus_queue.cc:237] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:24.162326  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 44674.1us
W20260709 12:15:24.164989  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 99569.3us
I20260709 12:15:24.169525  8528 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
W20260709 12:15:24.169883  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 103832us
I20260709 12:15:24.201865  8153 catalog_manager.cc:5697] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.203747  8534 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.205842  8536 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.206785  8528 tablet_bootstrap.cc:654] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.211985  8526 tablet_bootstrap.cc:654] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.222421  8576 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:24.222139  8532 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.225860  8532 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.226588  8527 ts_tablet_manager.cc:1434] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.239s	user 0.004s	sys 0.004s
I20260709 12:15:24.227888  8527 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:24.232616  8525 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.232721  8445 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:24.233445  8525 ts_tablet_manager.cc:1403] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.214s	user 0.034s	sys 0.046s
I20260709 12:15:24.234022  8534 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.234483  8534 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.234861  8534 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.249029  8405 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.241504  8532 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.253599  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:24.254650  8480 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.263406  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.265976  8525 raft_consensus.cc:359] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.277930  8525 raft_consensus.cc:385] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.285986  8528 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.286630  8528 ts_tablet_manager.cc:1403] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.022s
I20260709 12:15:24.277179  8534 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.293708  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:24.297976  8298 leader_election.cc:343] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.294571  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.285600  8525 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.299489  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:24.300419  8525 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.301146  8446 leader_election.cc:343] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.301363  8528 raft_consensus.cc:359] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.302074  8528 raft_consensus.cc:385] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.302350  8528 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.304865  8577 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.303464  8534 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:24.303225  8528 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.307076  8525 ts_tablet_manager.cc:1434] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.002s
I20260709 12:15:24.308120  8525 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.308326  8528 ts_tablet_manager.cc:1434] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:15:24.309226  8528 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.314764  8525 tablet_bootstrap.cc:654] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.315260  8528 tablet_bootstrap.cc:654] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.316545  8369 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.287120  8536 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:24.317804  8532 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.320526  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:24.321375  8405 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.324055  8154 catalog_manager.cc:5697] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.365298  8527 tablet_bootstrap.cc:654] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.330389  8480 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:24.336625  8405 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:24.337699  8479 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.345755  8525 tablet_bootstrap.cc:492] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.353216  8526 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.359411  8579 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.360466  8528 tablet_bootstrap.cc:492] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.378898  8528 ts_tablet_manager.cc:1403] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.005s
I20260709 12:15:24.379757  8296 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:24.380065  8445 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:24.381068  8536 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.381788  8525 ts_tablet_manager.cc:1403] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.004s
I20260709 12:15:24.382616  8536 raft_consensus.cc:697] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:24.382802  8577 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.383489  8577 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.384109  8561 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.369566  8566 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.383695  8536 consensus_queue.cc:237] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.384958  8561 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:24.385178  8526 ts_tablet_manager.cc:1403] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.273s	user 0.010s	sys 0.007s
I20260709 12:15:24.385896  8577 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.385948  8561 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.390048  8526 raft_consensus.cc:359] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.391047  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.385007  8566 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.393043  8446 leader_election.cc:343] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.394531  8566 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.394678  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.395141  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.390647  8525 raft_consensus.cc:359] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.396338  8525 raft_consensus.cc:385] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.396766  8525 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
W20260709 12:15:24.396930  8221 leader_election.cc:343] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.396209  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.397441  8525 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.398607  8443 leader_election.cc:343] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.399153  8443 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.399526  8404 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.401991  8577 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.403693  8525 ts_tablet_manager.cc:1434] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 12:15:24.403815  8535 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.404372  8535 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.406490  8535 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:24.406752  8576 consensus_queue.cc:1048] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.416513  8528 raft_consensus.cc:359] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.417448  8528 raft_consensus.cc:385] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.417814  8528 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.418572  8528 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.422978  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.423337  8525 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.423804  8331 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:24.425310  8220 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:24.426519  8579 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.426946  8579 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.427414  8579 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.429548  8155 catalog_manager.cc:5697] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.432552  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.437728  8528 ts_tablet_manager.cc:1434] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.003s
W20260709 12:15:24.438629  8222 leader_election.cc:343] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.438925  8528 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.390928  8526 raft_consensus.cc:385] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.443639  8526 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.443574  8566 consensus_queue.cc:1048] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:24.444692  8526 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.445659  8330 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:24.448871  8220 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:24.450461  8576 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.450855  8576 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.451238  8576 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.462936  8525 tablet_bootstrap.cc:654] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.465891  8576 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.467372  8564 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.468057  8564 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.471097  8564 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.472437  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.473698  8403 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:24.474686  8526 ts_tablet_manager.cc:1434] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 12:15:24.475831  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.476233  8526 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:24.479813  8534 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.480562  8534 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.484385  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.485427  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.486142  8330 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:24.487767  8443 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:24.483734  8534 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.489787  8534 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.490284  8534 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.490720  8534 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.490962  8528 tablet_bootstrap.cc:654] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.492756  8296 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.494194  8564 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.494946  8525 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.495493  8525 ts_tablet_manager.cc:1403] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.001s
I20260709 12:15:24.498463  8525 raft_consensus.cc:359] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.499336  8525 raft_consensus.cc:385] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.499672  8525 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.500653  8525 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.503060  8525 ts_tablet_manager.cc:1434] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:24.506366  8576 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.506676  8527 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
W20260709 12:15:24.507186  8614 log.cc:927] Time spent T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:15:24.507319  8527 ts_tablet_manager.cc:1403] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.280s	user 0.024s	sys 0.003s
I20260709 12:15:24.507243  8256 raft_consensus.cc:2393] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:24.510497  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:24.511178  8527 raft_consensus.cc:359] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.511788  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.512457  8527 raft_consensus.cc:385] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.512854  8527 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.504181  8525 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.512954  8330 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.513885  8527 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.509232  8579 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.519886  8577 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:24.520462  8577 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.520758  8527 ts_tablet_manager.cc:1434] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:15:24.522022  8527 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:24.525348  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.526219  8526 tablet_bootstrap.cc:654] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.527931  8577 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.529815  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.531425  8576 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.533033  8576 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.535513  8576 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.536659  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.538609  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:24.538903  8221 leader_election.cc:343] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:24.543284  8220 leader_election.cc:343] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.543778  8220 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.544660  8576 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.550120  8155 catalog_manager.cc:5697] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.551857  8534 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.553223  8478 raft_consensus.cc:2393] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:24.555244  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:24.556083  8443 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.559984  8577 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:24.556099  8256 raft_consensus.cc:2393] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:24.561012  8579 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:24.562682  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.554394  8534 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.557268  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.558815  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:24.564576  8443 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.566390  8331 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:24.566701  8222 leader_election.cc:343] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.568226  8527 tablet_bootstrap.cc:654] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.568575  8564 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.569553  8525 tablet_bootstrap.cc:654] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.572908  8534 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.578857  8331 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.581485  8528 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.583153  8528 ts_tablet_manager.cc:1403] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.013s
I20260709 12:15:24.587474  8220 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.587388  8528 raft_consensus.cc:359] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.588487  8528 raft_consensus.cc:385] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.588871  8528 raft_consensus.cc:740] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.589933  8528 consensus_queue.cc:260] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.590874  8624 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.591792  8624 raft_consensus.cc:697] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:24.592661  8624 consensus_queue.cc:237] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.593210  8528 ts_tablet_manager.cc:1434] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:24.595069  8597 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.596174  8597 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.598272  8330 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.598865  8597 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.600664  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.603139  8528 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.599483  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:24.605710  8369 leader_election.cc:343] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.606494  8220 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:24.608132  8566 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.608798  8566 raft_consensus.cc:697] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:24.609907  8566 consensus_queue.cc:237] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.617532  8372 leader_election.cc:343] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.618057  8372 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.619297  8597 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.623256  8526 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.623821  8526 ts_tablet_manager.cc:1403] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.013s
I20260709 12:15:24.625912  8534 consensus_queue.cc:1048] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.626531  8527 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:24.626961  8577 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.627305  8527 ts_tablet_manager.cc:1403] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.005s
I20260709 12:15:24.627488  8577 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.627929  8526 raft_consensus.cc:359] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.629649  8526 raft_consensus.cc:385] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.629804  8577 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:24.629978  8526 raft_consensus.cc:740] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.630810  8526 consensus_queue.cc:260] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.632532  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.633083  8526 ts_tablet_manager.cc:1434] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:24.634123  8526 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
W20260709 12:15:24.634048  8445 leader_election.cc:343] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:24.634363  8222 consensus_peers.cc:597] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:24.635076  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:24.636586  8446 leader_election.cc:343] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.637061  8446 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.638062  8534 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:24.640066  8527 raft_consensus.cc:359] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.640916  8527 raft_consensus.cc:385] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.641227  8527 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.641772  8526 tablet_bootstrap.cc:654] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.647661  8155 catalog_manager.cc:5697] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.653385  8577 consensus_queue.cc:1048] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.653852  8526 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.654558  8526 ts_tablet_manager.cc:1403] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:15:24.657552  8526 raft_consensus.cc:359] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.658457  8526 raft_consensus.cc:385] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.658937  8526 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.660009  8526 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.642221  8527 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.662741  8527 ts_tablet_manager.cc:1434] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 12:15:24.662842  8526 ts_tablet_manager.cc:1434] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:24.663892  8527 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:24.664655  8526 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:24.668210  8154 catalog_manager.cc:5697] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.669842  8528 tablet_bootstrap.cc:654] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.641620  8525 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.671093  8525 ts_tablet_manager.cc:1403] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.167s	user 0.035s	sys 0.021s
I20260709 12:15:24.672065  8526 tablet_bootstrap.cc:654] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.677882  8525 raft_consensus.cc:359] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.683513  8525 raft_consensus.cc:385] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.683842  8525 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
W20260709 12:15:24.684873  8629 log.cc:927] Time spent T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:24.686960  8527 tablet_bootstrap.cc:654] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.685233  8525 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:24.688241  8628 log.cc:927] Time spent T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.059s	user 0.004s	sys 0.000s
I20260709 12:15:24.689464  8525 ts_tablet_manager.cc:1434] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:15:24.690924  8525 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.703404  8526 tablet_bootstrap.cc:492] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.704097  8526 ts_tablet_manager.cc:1403] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.004s
I20260709 12:15:24.706931  8528 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.707198  8561 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.707490  8526 raft_consensus.cc:359] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.707888  8528 ts_tablet_manager.cc:1403] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.114s	user 0.006s	sys 0.010s
I20260709 12:15:24.708144  8525 tablet_bootstrap.cc:654] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.707815  8561 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.710402  8561 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:24.711270  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.711998  8330 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:24.712131  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.712275  8528 raft_consensus.cc:359] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.713558  8528 raft_consensus.cc:385] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.713881  8528 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.714370  8443 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:24.715297  8561 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.715721  8561 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.716104  8561 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.708321  8526 raft_consensus.cc:385] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.717119  8526 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.717981  8526 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.720480  8526 ts_tablet_manager.cc:1434] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:15:24.721480  8526 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:24.714787  8528 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.727625  8445 leader_election.cc:343] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.727758  8528 ts_tablet_manager.cc:1434] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:15:24.728868  8528 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.732038  8526 tablet_bootstrap.cc:654] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.735013  8528 tablet_bootstrap.cc:654] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.740105  8561 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.743167  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.743582  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:24.743834  8330 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:24.745195  8445 leader_election.cc:343] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.745863  8561 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:24.748816  8528 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.749421  8528 ts_tablet_manager.cc:1403] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.001s
I20260709 12:15:24.752393  8525 tablet_bootstrap.cc:492] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.752935  8525 ts_tablet_manager.cc:1403] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.000s
I20260709 12:15:24.753587  8526 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.754245  8526 ts_tablet_manager.cc:1403] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:15:24.753580  8528 raft_consensus.cc:359] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.754783  8528 raft_consensus.cc:385] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.755119  8624 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.755219  8528 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.755991  8624 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.756341  8566 consensus_queue.cc:1048] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.756552  8528 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.758214  8624 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.759076  8528 ts_tablet_manager.cc:1434] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:24.759877  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.760130  8528 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.760408  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.761226  8478 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
W20260709 12:15:24.762312  8222 leader_election.cc:343] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.763198  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.764463  8624 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.764873  8624 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.765213  8624 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.766029  8526 raft_consensus.cc:359] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.766772  8526 raft_consensus.cc:385] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.767067  8526 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.767876  8528 tablet_bootstrap.cc:654] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.768234  8525 raft_consensus.cc:359] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.769171  8525 raft_consensus.cc:385] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.769536  8525 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.770666  8256 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.770905  8526 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.773969  8526 ts_tablet_manager.cc:1434] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:15:24.775054  8526 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:24.781330  8536 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.782084  8536 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.781385  8564 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:15:24.787995  8534 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.788666  8534 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.790638  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:24.791494  8405 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:24.791684  8534 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.790884  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.792436  8480 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:24.792896  8297 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:24.792935  8525 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.794241  8564 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.794662  8564 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.795033  8564 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.795630  8525 ts_tablet_manager.cc:1434] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:15:24.796671  8525 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.799391  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.801136  8330 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:24.827617  8527 tablet_bootstrap.cc:492] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:24.828408  8527 ts_tablet_manager.cc:1403] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.165s	user 0.031s	sys 0.016s
I20260709 12:15:24.802471  8525 tablet_bootstrap.cc:654] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:24.805025  8443 leader_election.cc:343] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.830318  8443 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.830945  8528 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.831658  8534 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.831449  8527 raft_consensus.cc:359] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.832044  8528 ts_tablet_manager.cc:1403] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.013s
I20260709 12:15:24.832239  8527 raft_consensus.cc:385] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.806298  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:24.832230  8534 raft_consensus.cc:697] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:24.810860  8564 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.832893  8257 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:24.790671  8536 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.833531  8534 consensus_queue.cc:237] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.834378  8536 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.805533  8566 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.836510  8566 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.838732  8566 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.839600  8446 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.820539  8624 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.840507  8561 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.792001  8526 tablet_bootstrap.cc:654] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.841279  8561 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.841675  8561 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.842324  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.842733  8624 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.843051  8478 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:24.840430  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:24.844529  8405 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.834643  8564 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:24.844660  8624 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.845508  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:24.845470  8624 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:24.847546  8222 leader_election.cc:343] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.848747  8624 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.849428  8221 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:24.850307  8561 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.851109  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:24.851368  8624 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:24.851878  8624 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.852291  8624 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.853366  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:24.850878  8528 raft_consensus.cc:359] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.852820  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:24.853978  8257 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.854322  8478 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.862203  8257 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:24.863500  8478 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.863698  8446 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:24.864711  8621 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.865358  8621 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:24.832609  8527 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.866423  8621 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.867507  8527 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.868350  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.869287  8405 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
W20260709 12:15:24.869736  8443 leader_election.cc:343] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:24.870373  8561 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.871140  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:24.871949  8480 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.871953  8528 raft_consensus.cc:385] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.873605  8528 raft_consensus.cc:740] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.877601  8528 consensus_queue.cc:260] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.880579  8526 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:24.881141  8526 ts_tablet_manager.cc:1403] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.106s	user 0.006s	sys 0.007s
I20260709 12:15:24.881460  8297 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:24.883705  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.884408  8330 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:24.885797  8526 raft_consensus.cc:359] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.886543  8526 raft_consensus.cc:385] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.886638  8643 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.886909  8526 raft_consensus.cc:740] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.886277  8152 catalog_manager.cc:5697] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.887212  8643 raft_consensus.cc:697] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:24.887384  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:24.887697  8526 consensus_queue.cc:260] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:24.888471  8643 consensus_queue.cc:237] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:24.889892  8526 ts_tablet_manager.cc:1434] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:24.889688  8220 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:24.891003  8566 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:24.892863  8480 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:24.894148  8528 ts_tablet_manager.cc:1434] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
W20260709 12:15:24.895097  8446 consensus_peers.cc:597] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c -> Peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Couldn't send request to peer 29d436e9d3d54fe599d9aa67d38fba03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:24.895462  8528 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:24.880636  8527 ts_tablet_manager.cc:1434] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:15:24.896855  8527 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:24.905678  8526 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
W20260709 12:15:24.908350  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 88155.4us
I20260709 12:15:24.915339  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:24.917568  8579 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.918108  8579 raft_consensus.cc:697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:24.918673  8624 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.919756  8579 consensus_queue.cc:237] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.921187  8624 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:24.922339  8526 tablet_bootstrap.cc:654] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.928591  8528 tablet_bootstrap.cc:654] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.928650  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:24.929440  8478 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.933305  8621 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:24.932847  8153 catalog_manager.cc:5697] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.940567  8478 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.942044  8221 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:24.945858  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:24.946738  8566 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:24.947505  8566 raft_consensus.cc:697] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:24.948455  8527 tablet_bootstrap.cc:654] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.948382  8566 consensus_queue.cc:237] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:24.951093  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:24.951824  8331 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:24.953613  8525 tablet_bootstrap.cc:492] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:24.955587  8525 ts_tablet_manager.cc:1403] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.159s	user 0.011s	sys 0.000s
I20260709 12:15:24.970479  8525 raft_consensus.cc:359] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.971428  8525 raft_consensus.cc:385] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:24.971812  8525 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:24.972919  8525 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:24.973790  8153 catalog_manager.cc:5697] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:24.976445  8525 ts_tablet_manager.cc:1434] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:15:24.977694  8525 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:24.977979  8331 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:24.978507  8154 catalog_manager.cc:5697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:24.984997  8525 tablet_bootstrap.cc:654] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:24.995569  8528 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:24.996464  8528 ts_tablet_manager.cc:1403] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.019s
I20260709 12:15:24.999752  8528 raft_consensus.cc:359] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.000564  8528 raft_consensus.cc:385] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.000929  8528 raft_consensus.cc:740] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.001765  8528 consensus_queue.cc:260] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.009390  8527 tablet_bootstrap.cc:492] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.010012  8527 ts_tablet_manager.cc:1403] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.006s
I20260709 12:15:25.013406  8526 tablet_bootstrap.cc:492] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:25.013144  8527 raft_consensus.cc:359] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.013943  8526 ts_tablet_manager.cc:1403] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.005s
I20260709 12:15:25.014003  8527 raft_consensus.cc:385] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.014515  8527 raft_consensus.cc:740] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.016706  8528 ts_tablet_manager.cc:1434] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:15:25.016974  8526 raft_consensus.cc:359] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.017752  8526 raft_consensus.cc:385] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.018039  8526 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.018222  8528 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.018952  8526 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.020653  8527 consensus_queue.cc:260] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.021232  8526 ts_tablet_manager.cc:1434] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:25.022063  8525 tablet_bootstrap.cc:492] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:25.022392  8526 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:25.022763  8525 ts_tablet_manager.cc:1403] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.000s
I20260709 12:15:25.025902  8527 ts_tablet_manager.cc:1434] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:15:25.026067  8525 raft_consensus.cc:359] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.027037  8527 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.026957  8525 raft_consensus.cc:385] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.027530  8525 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.028465  8525 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.029359  8526 tablet_bootstrap.cc:654] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.031212  8525 ts_tablet_manager.cc:1434] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:15:25.032430  8525 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:25.025204  8152 catalog_manager.cc:5697] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.037778  8527 tablet_bootstrap.cc:654] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.041901  8525 tablet_bootstrap.cc:654] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.042560  8528 tablet_bootstrap.cc:654] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.053658  8526 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:25.054193  8526 ts_tablet_manager.cc:1403] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.006s
I20260709 12:15:25.056675  8525 tablet_bootstrap.cc:492] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:25.057453  8525 ts_tablet_manager.cc:1403] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:15:25.057404  8526 raft_consensus.cc:359] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.058849  8526 raft_consensus.cc:385] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.059180  8526 raft_consensus.cc:740] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.060001  8526 consensus_queue.cc:260] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.061229  8527 tablet_bootstrap.cc:492] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.061793  8527 ts_tablet_manager.cc:1403] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 12:15:25.062064  8526 ts_tablet_manager.cc:1434] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:15:25.063410  8528 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:25.063885  8528 ts_tablet_manager.cc:1403] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.006s
I20260709 12:15:25.064219  8525 raft_consensus.cc:359] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.065096  8525 raft_consensus.cc:385] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.065491  8525 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.066417  8525 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.066635  8528 raft_consensus.cc:359] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.067396  8528 raft_consensus.cc:385] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.064761  8527 raft_consensus.cc:359] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.067647  8579 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.068367  8526 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:25.068270  8579 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.067677  8528 raft_consensus.cc:740] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.069635  8528 consensus_queue.cc:260] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.072384  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.071589  8525 ts_tablet_manager.cc:1434] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:15:25.073153  8331 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:25.073995  8525 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:25.075026  8526 tablet_bootstrap.cc:654] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.075062  8528 ts_tablet_manager.cc:1434] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:25.077471  8528 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.079449  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.080332  8405 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:25.087141  8525 tablet_bootstrap.cc:654] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.088163  8405 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.088382  8222 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:25.089613  8535 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.090094  8535 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.090497  8535 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.070803  8579 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.097115  8579 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.105810  8535 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.107121  8527 raft_consensus.cc:385] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.107555  8527 raft_consensus.cc:740] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.110306  8527 consensus_queue.cc:260] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.115427  8528 tablet_bootstrap.cc:654] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.120983  8577 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.121770  8577 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.127492  8527 ts_tablet_manager.cc:1434] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 12:15:25.127877  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.128556  8597 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.128654  8331 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:25.129520  8597 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.133945  8597 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:25.135114  8443 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:25.135217  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.136267  8534 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.136595  8331 raft_consensus.cc:2393] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:25.136842  8534 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.137460  8534 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.141798  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:25.144462  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.145248  8621 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.146062  8621 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.150066  8621 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:25.150269  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:25.151896  8445 leader_election.cc:343] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:25.152122  8446 leader_election.cc:343] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.153210  8370 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:25.156260  8527 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.157092  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:25.158752  8443 leader_election.cc:343] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.159427  8443 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:25.160856  8597 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.161052  8621 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.162765  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:25.163853  8406 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:25.164702  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 66985.2us
I20260709 12:15:25.168063  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:25.168975  8330 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.169521  8535 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.129518  8577 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.202091  8527 tablet_bootstrap.cc:654] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.225412  8666 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.226603  8666 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.208776  8330 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:25.211877  8528 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:25.214437  8566 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.229295  8528 ts_tablet_manager.cc:1403] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.000s
I20260709 12:15:25.230872  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:25.215598  8624 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.235450  8666 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.206602  8406 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:25.237223  8528 raft_consensus.cc:359] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.239415  8528 raft_consensus.cc:385] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.240182  8528 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.245491  8528 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.250885  8527 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.251639  8527 ts_tablet_manager.cc:1403] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.006s
I20260709 12:15:25.247212  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.249135  8256 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.253139  8528 ts_tablet_manager.cc:1434] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:15:25.260141  8528 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.262347  8527 raft_consensus.cc:359] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.263216  8527 raft_consensus.cc:385] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.263517  8527 raft_consensus.cc:740] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.264434  8527 consensus_queue.cc:260] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.267167  8527 ts_tablet_manager.cc:1434] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:15:25.269899  8527 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.279263  8621 consensus_queue.cc:1048] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.281257  8643 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.255272  8220 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:25.296065  8643 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.302084  8643 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.304986  8257 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.322654  8528 tablet_bootstrap.cc:654] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.312135  8624 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.329499  8624 raft_consensus.cc:697] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:25.335929  8527 tablet_bootstrap.cc:654] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.311069  8534 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.341922  8597 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.345636  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:25.349965  8329 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.353533  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:25.355505  8445 leader_election.cc:343] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:25.311429  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 62631.9us
I20260709 12:15:25.356637  8669 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.356925  8372 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:25.357399  8669 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.357913  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.358565  8597 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:25.359968  8298 leader_election.cc:343] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.331481  8624 consensus_queue.cc:237] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.370409  8579 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.375767  8526 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:25.376441  8526 ts_tablet_manager.cc:1403] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.308s	user 0.072s	sys 0.119s
I20260709 12:15:25.365345  8534 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.375725  8332 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.382395  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.388586  8526 raft_consensus.cc:359] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.389422  8526 raft_consensus.cc:385] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.389725  8526 raft_consensus.cc:740] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.380149  8329 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:25.396727  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.390477  8526 consensus_queue.cc:260] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.397742  8443 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:25.398101  8222 consensus_peers.cc:597] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:25.399544  8526 ts_tablet_manager.cc:1434] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:15:25.399657  8577 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.400305  8577 raft_consensus.cc:697] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:25.400698  8526 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:25.401182  8577 consensus_queue.cc:237] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.417158  8525 tablet_bootstrap.cc:492] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:25.417649  8525 ts_tablet_manager.cc:1403] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.344s	user 0.078s	sys 0.142s
I20260709 12:15:25.424266  8669 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:25.411427  8621 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.425555  8535 consensus_queue.cc:1048] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:15:25.414131  8297 leader_election.cc:343] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.433064  8297 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.440579  8528 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:25.441538  8528 ts_tablet_manager.cc:1403] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.182s	user 0.023s	sys 0.007s
I20260709 12:15:25.446975  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.448889  8369 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:25.449805  8527 tablet_bootstrap.cc:492] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.450249  8669 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:25.450706  8566 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:25.450296  8527 ts_tablet_manager.cc:1403] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.005s
I20260709 12:15:25.451336  8566 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.451887  8528 raft_consensus.cc:359] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.431146  8621 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.452945  8528 raft_consensus.cc:385] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.453385  8528 raft_consensus.cc:740] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.446784  8642 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.456105  8642 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.454521  8528 consensus_queue.cc:260] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.460486  8642 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.462553  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:25.463742  8525 raft_consensus.cc:359] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.464813  8525 raft_consensus.cc:385] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.465224  8525 raft_consensus.cc:740] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.446743  8647 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.470222  8525 consensus_queue.cc:260] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.473197  8527 raft_consensus.cc:359] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.473997  8527 raft_consensus.cc:385] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.474283  8527 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.477499  8525 ts_tablet_manager.cc:1434] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 12:15:25.478569  8525 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:25.478096  8527 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.478798  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.481021  8527 ts_tablet_manager.cc:1434] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:15:25.485221  8527 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.490737  8526 tablet_bootstrap.cc:654] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.480934  8643 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:15:25.488116  8621 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.508246  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.518684  8255 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:25.493388  8624 consensus_queue.cc:1048] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:25.493456  8678 consensus_queue.cc:1048] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:15:25.508335  8621 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:15:25.533908  8566 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.535578  8527 tablet_bootstrap.cc:654] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.548630  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.579177  8564 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:25.572572  8642 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.582916  8525 tablet_bootstrap.cc:654] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.568890  8561 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:15:25.577157  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.581887  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.595659  8298 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:25.598723  8446 leader_election.cc:343] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.599879  8528 ts_tablet_manager.cc:1434] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.155s	user 0.013s	sys 0.007s
I20260709 12:15:25.584052  8642 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.603078  8528 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.609179  8526 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:25.609872  8526 ts_tablet_manager.cc:1403] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.209s	user 0.019s	sys 0.005s
W20260709 12:15:25.611541  8445 leader_election.cc:343] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.612048  8445 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.613796  8561 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.601819  8222 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.615801  8566 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:25.617353  8566 consensus_queue.cc:1048] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:25.632273  8526 raft_consensus.cc:359] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.632979  8526 raft_consensus.cc:385] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.633224  8526 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.634109  8526 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.638109  8528 tablet_bootstrap.cc:654] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.644526  8527 tablet_bootstrap.cc:492] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.645716  8527 ts_tablet_manager.cc:1403] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.005s
I20260709 12:15:25.630683  8647 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:25.651459  8155 catalog_manager.cc:5697] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:25.661115  8647 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:25.661878  8647 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:25.673257  8642 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.674196  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.673328  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:25.675884  8680 log.cc:927] Time spent T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 12:15:25.676100  8479 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
W20260709 12:15:25.677690  8298 leader_election.cc:343] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.679025  8296 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:25.686769  8526 ts_tablet_manager.cc:1434] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.077s	user 0.027s	sys 0.023s
I20260709 12:15:25.688277  8526 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:25.692214  8689 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.693681  8689 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.697723  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:25.699774  8446 leader_election.cc:343] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.701292  8689 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:25.702682  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.702992  8669 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.703528  8332 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:25.703579  8669 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.705101  8443 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:25.706660  8669 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.689239  8642 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.707686  8689 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.710711  8689 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.709180  8642 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.713253  8689 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.715214  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.714147  8642 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.726639  8403 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.730959  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:25.737353  8370 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:25.746759  8668 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.743477  8669 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.735232  8525 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:25.748812  8669 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.742974  8526 tablet_bootstrap.cc:654] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.749758  8525 ts_tablet_manager.cc:1403] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.271s	user 0.016s	sys 0.005s
I20260709 12:15:25.755767  8525 raft_consensus.cc:359] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.757493  8525 raft_consensus.cc:385] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.758069  8525 raft_consensus.cc:740] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.759217  8525 consensus_queue.cc:260] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.755090  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.764185  8527 raft_consensus.cc:359] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.764830  8256 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:25.757586  8669 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.765309  8527 raft_consensus.cc:385] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.767103  8527 raft_consensus.cc:740] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.764122  8152 catalog_manager.cc:5697] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.766206  8402 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.760426  8689 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.773900  8527 consensus_queue.cc:260] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.782061  8528 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:25.782640  8528 ts_tablet_manager.cc:1403] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.006s
I20260709 12:15:25.783789  8525 ts_tablet_manager.cc:1434] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:15:25.785557  8525 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:25.774718  8372 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:25.789767  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:25.789949  8689 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:25.790220  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:25.790829  8332 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:25.791312  8446 leader_election.cc:343] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.792138  8526 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:25.777210  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:25.793356  8478 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:25.799202  8526 ts_tablet_manager.cc:1403] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.001s
I20260709 12:15:25.800812  8668 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.801831  8528 raft_consensus.cc:359] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.802366  8528 raft_consensus.cc:385] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.802625  8527 ts_tablet_manager.cc:1434] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.000s
I20260709 12:15:25.802563  8528 raft_consensus.cc:740] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.803640  8528 consensus_queue.cc:260] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.801558  8668 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.805383  8668 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.807785  8528 ts_tablet_manager.cc:1434] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 12:15:25.808076  8527 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.808795  8528 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.772723  8647 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.821734  8330 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:25.822109  8528 tablet_bootstrap.cc:654] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.823338  8647 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.823997  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:25.824976  8566 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.825547  8566 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.817684  8642 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.826090  8527 tablet_bootstrap.cc:654] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.828004  8566 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.828696  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:25.829396  8331 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:25.830686  8220 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:25.835541  8682 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:25.835692  8561 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.835999  8682 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.836175  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.836498  8682 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.836351  8561 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:25.839308  8222 leader_election.cc:343] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.842083  8642 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.838567  8624 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:15:25.844048  8445 consensus_peers.cc:597] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:25.845712  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:25.847342  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:25.847493  8561 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:25.847594  8298 leader_election.cc:343] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.847985  8478 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.849458  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:25.851922  8443 leader_election.cc:343] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.860873  8527 tablet_bootstrap.cc:492] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:25.861673  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.862715  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:25.863696  8445 leader_election.cc:343] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.863902  8689 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:25.864289  8445 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.865593  8561 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:25.865973  8561 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:25.866267  8296 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:25.854430  8332 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:25.866863  8561 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.868613  8682 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.868883  8561 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:25.870389  8527 ts_tablet_manager.cc:1403] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.008s
I20260709 12:15:25.834434  8668 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.867195  8621 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.873754  8642 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:25.879496  8405 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.879822  8682 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:25.872614  8443 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:25.884418  8621 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.884984  8621 raft_consensus.cc:697] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:25.885877  8621 consensus_queue.cc:237] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.887219  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:25.892120  8222 leader_election.cc:343] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.893210  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:25.894264  8332 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.899250  8689 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.899863  8689 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:25.902204  8689 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.903537  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:25.904593  8332 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:25.906761  8446 leader_election.cc:343] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.906594  8220 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.905450  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:25.907841  8682 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.908483  8682 raft_consensus.cc:697] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:25.909487  8445 leader_election.cc:343] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:25.910163  8445 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:25.909574  8682 consensus_queue.cc:237] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.909641  8525 tablet_bootstrap.cc:654] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:25.902019  8527 raft_consensus.cc:359] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.914891  8527 raft_consensus.cc:385] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.915251  8527 raft_consensus.cc:740] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.914461  8526 raft_consensus.cc:359] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.918267  8526 raft_consensus.cc:385] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.918795  8526 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.919909  8526 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:25.926470  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:25.927248  8255 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.927490  8526 ts_tablet_manager.cc:1434] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.127s	user 0.004s	sys 0.005s
I20260709 12:15:25.925138  8668 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:25.931277  8527 consensus_queue.cc:260] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:25.916863  8689 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:25.935667  8528 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:25.936295  8528 ts_tablet_manager.cc:1403] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.003s
I20260709 12:15:25.929179  8526 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:25.927999  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:25.944329  8479 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:25.919101  8478 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:25.948208  8527 ts_tablet_manager.cc:1434] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:15:25.949158  8527 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:25.946115  8528 raft_consensus.cc:359] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.950736  8528 raft_consensus.cc:385] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:25.951205  8528 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:25.957423  8528 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.976858  8296 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:25.978538  8642 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:25.979146  8642 raft_consensus.cc:697] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:25.980161  8642 consensus_queue.cc:237] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:25.989544  8528 ts_tablet_manager.cc:1434] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:15:25.990489  8528 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:25.996438  8525 tablet_bootstrap.cc:492] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:25.997038  8525 ts_tablet_manager.cc:1403] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.010s
I20260709 12:15:26.002725  8479 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:26.016566  8525 raft_consensus.cc:359] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.018262  8525 raft_consensus.cc:385] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.018590  8525 raft_consensus.cc:740] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.016367  8689 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.023355  8370 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:26.023307  8689 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.024446  8668 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.025017  8668 raft_consensus.cc:697] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:26.025609  8689 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:26.025966  8668 consensus_queue.cc:237] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.026502  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.027503  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.016800  8621 consensus_queue.cc:1048] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 12:15:26.028178  8446 leader_election.cc:343] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.034505  8255 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:26.041400  8527 tablet_bootstrap.cc:654] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.049674  8525 consensus_queue.cc:260] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.052935  8681 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:26.054780  8443 leader_election.cc:343] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.055398  8443 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:26.055631  8714 log.cc:927] Time spent T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:15:26.057197  8561 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.057689  8152 catalog_manager.cc:5697] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.059906  8528 tablet_bootstrap.cc:654] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.066004  8525 ts_tablet_manager.cc:1434] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 12:15:26.067094  8525 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:26.075944  8154 catalog_manager.cc:5697] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.085037  8709 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:26.085758  8526 tablet_bootstrap.cc:654] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.085717  8709 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.066583  8155 catalog_manager.cc:5697] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.091276  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.091346  8709 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:26.092392  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.094313  8369 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:26.095114  8528 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:26.095618  8528 ts_tablet_manager.cc:1403] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.000s
W20260709 12:15:26.097729  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:26.103811  8528 raft_consensus.cc:359] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.104584  8528 raft_consensus.cc:385] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.104856  8528 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.099978  8525 tablet_bootstrap.cc:654] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.100229  8709 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:26.115958  8528 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.117702  8528 ts_tablet_manager.cc:1434] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:15:26.118614  8528 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:26.125159  8527 tablet_bootstrap.cc:492] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:26.125828  8527 ts_tablet_manager.cc:1403] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.001s
I20260709 12:15:26.128857  8527 raft_consensus.cc:359] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.129595  8527 raft_consensus.cc:385] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.129877  8527 raft_consensus.cc:740] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.130553  8527 consensus_queue.cc:260] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.134480  8527 ts_tablet_manager.cc:1434] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:26.135457  8527 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:26.137478  8526 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:26.141269  8526 ts_tablet_manager.cc:1403] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.008s
I20260709 12:15:26.144280  8526 raft_consensus.cc:359] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.151666  8526 raft_consensus.cc:385] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.152148  8526 raft_consensus.cc:740] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.153056  8526 consensus_queue.cc:260] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.155432  8527 tablet_bootstrap.cc:654] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.158740  8525 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:26.159853  8525 ts_tablet_manager.cc:1403] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 12:15:26.159094  8154 catalog_manager.cc:5697] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.160313  8668 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.160887  8668 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.162599  8525 raft_consensus.cc:359] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.163354  8525 raft_consensus.cc:385] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.163612  8525 raft_consensus.cc:740] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.164146  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.166042  8668 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:26.166182  8647 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.166775  8647 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.169332  8528 tablet_bootstrap.cc:654] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.170540  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.171317  8478 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:26.173200  8525 consensus_queue.cc:260] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.175292  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:26.176018  8525 ts_tablet_manager.cc:1434] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:15:26.176602  8527 tablet_bootstrap.cc:492] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:26.176674  8695 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.177122  8527 ts_tablet_manager.cc:1403] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.001s
I20260709 12:15:26.177219  8695 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.177820  8695 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.180452  8527 raft_consensus.cc:359] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.181221  8527 raft_consensus.cc:385] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.181491  8527 raft_consensus.cc:740] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.182370  8527 consensus_queue.cc:260] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.184357  8527 ts_tablet_manager.cc:1434] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:26.185469  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.177012  8525 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
W20260709 12:15:26.191483  8297 leader_election.cc:343] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.192188  8647 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:26.193516  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.195390  8369 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:26.189975  8528 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:26.196436  8668 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.202550  8709 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.203055  8527 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:26.190148  8695 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.204712  8709 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.206969  8709 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:26.207885  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.207993  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:26.208490  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:26.209120  8479 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:26.209789  8297 leader_election.cc:343] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.219898  8479 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:26.221129  8528 ts_tablet_manager.cc:1403] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.000s
I20260709 12:15:26.221599  8695 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:26.221624  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:26.223734  8647 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.224251  8647 raft_consensus.cc:697] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:26.224473  8528 raft_consensus.cc:359] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.225426  8528 raft_consensus.cc:385] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.225201  8647 consensus_queue.cc:237] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.204054  8525 tablet_bootstrap.cc:654] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.226868  8527 tablet_bootstrap.cc:654] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.225739  8528 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.229319  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.229238  8528 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.235033  8525 tablet_bootstrap.cc:492] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:26.236752  8525 ts_tablet_manager.cc:1403] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.001s
I20260709 12:15:26.236789  8332 raft_consensus.cc:2393] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:26.238054  8528 ts_tablet_manager.cc:1434] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:26.238282  8369 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:26.239178  8528 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:26.239295  8668 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.198082  8526 ts_tablet_manager.cc:1434] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 12:15:26.243816  8526 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:26.246707  8528 tablet_bootstrap.cc:654] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.251499  8526 tablet_bootstrap.cc:654] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.253400  8525 raft_consensus.cc:359] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.254172  8525 raft_consensus.cc:385] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.254444  8525 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.255239  8525 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.257324  8525 ts_tablet_manager.cc:1434] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:15:26.252548  8668 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.264948  8527 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:26.267338  8527 ts_tablet_manager.cc:1403] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.004s
I20260709 12:15:26.271509  8525 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:26.271615  8526 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:26.272240  8526 ts_tablet_manager.cc:1403] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.010s
I20260709 12:15:26.272356  8527 raft_consensus.cc:359] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.273180  8527 raft_consensus.cc:385] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.273486  8527 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.274346  8527 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.275610  8526 raft_consensus.cc:359] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.276423  8526 raft_consensus.cc:385] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.276718  8526 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.277521  8526 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.279894  8526 ts_tablet_manager.cc:1434] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:15:26.280257  8527 ts_tablet_manager.cc:1434] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:26.280901  8526 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:26.281788  8527 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:26.283274  8525 tablet_bootstrap.cc:654] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.283574  8155 catalog_manager.cc:5697] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.287669  8526 tablet_bootstrap.cc:654] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.313588  8525 tablet_bootstrap.cc:492] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:26.314126  8525 ts_tablet_manager.cc:1403] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 12:15:26.316938  8525 raft_consensus.cc:359] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.317495  8257 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.317634  8525 raft_consensus.cc:385] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.318146  8525 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.319540  8525 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.330359  8525 ts_tablet_manager.cc:1434] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:15:26.329901  8689 consensus_queue.cc:1048] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:26.331533  8525 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:26.340137  8526 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:26.340646  8526 ts_tablet_manager.cc:1403] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.004s
I20260709 12:15:26.344632  8647 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.345149  8647 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.351693  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.352196  8647 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:26.352443  8255 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:26.353785  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.353992  8526 raft_consensus.cc:359] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.354564  8402 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:26.354866  8526 raft_consensus.cc:385] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.355355  8526 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.355439  8298 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:26.356149  8526 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.356462  8647 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.357249  8647 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.357642  8647 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.358206  8526 ts_tablet_manager.cc:1434] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:15:26.359298  8526 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:26.363746  8528 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:26.364324  8528 ts_tablet_manager.cc:1403] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.016s
I20260709 12:15:26.366168  8689 consensus_queue.cc:1048] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.375206  8525 tablet_bootstrap.cc:654] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.377926  8647 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.383883  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:26.384857  8402 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.385919  8647 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:26.409950  8528 raft_consensus.cc:359] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.413965  8402 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:26.427528  8297 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:26.415376  8528 raft_consensus.cc:385] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.423324  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:26.425338  8689 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.440325  8528 raft_consensus.cc:740] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.444027  8257 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.442873  8647 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.447118  8689 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.447877  8647 raft_consensus.cc:697] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:26.448866  8647 consensus_queue.cc:237] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.449728  8689 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:26.452013  8720 consensus_queue.cc:1048] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.454056  8405 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.459460  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.460093  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.460902  8331 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
W20260709 12:15:26.461696  8445 leader_election.cc:343] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.462426  8443 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:26.463517  8527 tablet_bootstrap.cc:654] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.464170  8561 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.464772  8561 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.465305  8528 consensus_queue.cc:260] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.475942  8621 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.476656  8621 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.477787  8528 ts_tablet_manager.cc:1434] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.113s	user 0.004s	sys 0.006s
I20260709 12:15:26.465282  8561 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.484150  8525 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:26.485111  8525 ts_tablet_manager.cc:1403] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.034s
I20260709 12:15:26.492708  8528 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:26.488238  8525 raft_consensus.cc:359] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.495146  8525 raft_consensus.cc:385] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.496163  8525 raft_consensus.cc:740] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.497043  8525 consensus_queue.cc:260] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.503791  8525 ts_tablet_manager.cc:1434] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:15:26.504979  8525 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:26.503396  8621 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:26.506888  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:26.508716  8443 leader_election.cc:343] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.511919  8720 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.512705  8720 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.513914  8681 consensus_queue.cc:1048] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.514091  8256 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.517053  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.517320  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.518242  8479 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:26.519079  8445 leader_election.cc:343] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.519855  8445 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:26.522805  8695 consensus_queue.cc:1048] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.527226  8689 raft_consensus.cc:2749] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.529697  8525 tablet_bootstrap.cc:654] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.531590  8720 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:26.546505  8720 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.547394  8720 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.532738  8526 tablet_bootstrap.cc:654] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.534101  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:26.535772  8257 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:26.541400  8561 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.555171  8695 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.568018  8695 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.580050  8527 tablet_bootstrap.cc:492] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:26.582540  8220 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:26.584332  8695 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:26.591379  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.586367  8681 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.584237  8527 ts_tablet_manager.cc:1403] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.303s	user 0.012s	sys 0.003s
I20260709 12:15:26.592180  8478 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:26.586232  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.592491  8525 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:26.594087  8525 ts_tablet_manager.cc:1403] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.006s
I20260709 12:15:26.596597  8528 tablet_bootstrap.cc:654] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.594161  8480 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:26.598601  8221 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:26.590750  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.600234  8681 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.602121  8681 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.602541  8681 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.602653  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.603488  8402 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:26.603521  8527 raft_consensus.cc:359] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.605504  8668 consensus_queue.cc:1048] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:26.604593  8527 raft_consensus.cc:385] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.587790  8720 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:26.607156  8527 raft_consensus.cc:740] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.619534  8527 consensus_queue.cc:260] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.620220  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:26.606298  8561 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:26.622363  8332 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:26.623865  8298 leader_election.cc:343] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.632095  8527 ts_tablet_manager.cc:1434] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:15:26.633116  8527 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:26.638482  8155 catalog_manager.cc:5697] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:26.636340  8695 consensus_queue.cc:1048] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:15:26.645229  8296 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:26.655858  8642 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.656342  8642 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.656697  8642 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.645037  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:26.657318  8668 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.669070  8527 tablet_bootstrap.cc:654] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.670888  8668 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:26.687381  8445 leader_election.cc:343] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.688107  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:26.693341  8668 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:26.693588  8477 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:26.698943  8681 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.701279  8681 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:26.702867  8370 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:26.704057  8668 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:26.709084  8668 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.709597  8668 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.710388  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.711166  8255 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:26.714179  8332 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:26.715963  8443 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:26.708266  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:26.717810  8689 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.709020  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:26.742218  8403 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.742475  8689 raft_consensus.cc:697] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:26.726914  8709 consensus_queue.cc:1048] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:15:26.744045  8689 consensus_queue.cc:237] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.722234  8477 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.724247  8642 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.776075  8561 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.782163  8561 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.784384  8561 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:26.788450  8525 raft_consensus.cc:359] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.789235  8525 raft_consensus.cc:385] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.789506  8525 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.790970  8525 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.797967  8526 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:26.798492  8526 ts_tablet_manager.cc:1403] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.439s	user 0.018s	sys 0.021s
I20260709 12:15:26.802269  8528 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:26.802843  8528 ts_tablet_manager.cc:1403] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.322s	user 0.008s	sys 0.024s
I20260709 12:15:26.794553  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:26.808480  8525 ts_tablet_manager.cc:1434] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.214s	user 0.007s	sys 0.001s
I20260709 12:15:26.816906  8528 raft_consensus.cc:359] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.817731  8528 raft_consensus.cc:385] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.818006  8528 raft_consensus.cc:740] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.818663  8528 consensus_queue.cc:260] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.834075  8525 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:26.836004  8528 ts_tablet_manager.cc:1434] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:15:26.826849  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:26.839463  8528 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:26.838388  8668 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:26.837188  8445 leader_election.cc:343] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.852313  8527 tablet_bootstrap.cc:492] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:26.863835  8527 ts_tablet_manager.cc:1403] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.231s	user 0.018s	sys 0.034s
I20260709 12:15:26.867424  8528 tablet_bootstrap.cc:654] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.867867  8525 tablet_bootstrap.cc:654] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.853173  8668 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:26.847289  8642 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:26.873878  8446 leader_election.cc:343] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.874419  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:26.848407  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:26.857311  8297 consensus_peers.cc:597] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:26.876771  8642 consensus_queue.cc:1048] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:26.877202  8477 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:26.879961  8221 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:26.872449  8526 raft_consensus.cc:359] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.881807  8526 raft_consensus.cc:385] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.882218  8526 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.883915  8689 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:26.884976  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:26.885630  8255 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.887008  8566 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.887573  8566 raft_consensus.cc:697] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:26.888459  8566 consensus_queue.cc:237] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.890796  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:26.891557  8479 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.884967  8403 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:26.897635  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:26.898311  8480 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:26.903831  8152 catalog_manager.cc:5697] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.905530  8527 raft_consensus.cc:359] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.906255  8527 raft_consensus.cc:385] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:26.906508  8527 raft_consensus.cc:740] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:26.883090  8526 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:26.914561  8526 ts_tablet_manager.cc:1434] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
W20260709 12:15:26.923058  8298 leader_election.cc:343] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.924803  8526 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:26.932869  8527 consensus_queue.cc:260] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:26.957461  8527 ts_tablet_manager.cc:1434] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.093s	user 0.000s	sys 0.006s
I20260709 12:15:26.958546  8527 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:26.961308  8479 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:26.938560  8255 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:26.939872  8480 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:26.950206  8561 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.966892  8296 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:26.967520  8561 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.968340  8370 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:26.968557  8642 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.969329  8668 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:26.948964  8153 catalog_manager.cc:5697] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.969844  8561 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:26.969818  8668 raft_consensus.cc:697] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:26.971096  8668 consensus_queue.cc:237] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:26.969347  8642 raft_consensus.cc:697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:26.975770  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:26.979254  8443 leader_election.cc:343] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.972677  8642 consensus_queue.cc:237] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:26.971308  8527 tablet_bootstrap.cc:654] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:26.984566  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:26.986979  8446 leader_election.cc:343] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:26.987697  8446 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:26.989421  8561 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.000161  8527 tablet_bootstrap.cc:492] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.000794  8527 ts_tablet_manager.cc:1403] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 12:15:27.010241  8527 raft_consensus.cc:359] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.014324  8527 raft_consensus.cc:385] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.014678  8527 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.015560  8527 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.020728  8527 ts_tablet_manager.cc:1434] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:15:27.021800  8527 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:27.027753  8155 catalog_manager.cc:5697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:27.031903  8760 log.cc:927] Time spent T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:15:27.046591  8527 tablet_bootstrap.cc:654] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.071388  8688 consensus_queue.cc:1048] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.075065  8525 tablet_bootstrap.cc:492] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:27.075415  8526 tablet_bootstrap.cc:654] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.075714  8525 ts_tablet_manager.cc:1403] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.051s
I20260709 12:15:27.080387  8528 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:27.079702  8153 catalog_manager.cc:5697] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.080953  8528 ts_tablet_manager.cc:1403] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.243s	user 0.029s	sys 0.042s
I20260709 12:15:27.083438  8528 raft_consensus.cc:359] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.084182  8528 raft_consensus.cc:385] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.085389  8528 raft_consensus.cc:740] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.078622  8525 raft_consensus.cc:359] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.086551  8525 raft_consensus.cc:385] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.086850  8525 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.087706  8528 consensus_queue.cc:260] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.088982  8525 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.089877  8688 consensus_queue.cc:1048] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.093401  8528 ts_tablet_manager.cc:1434] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:15:27.094372  8528 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:27.095216  8525 ts_tablet_manager.cc:1434] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:15:27.110425  8527 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.111049  8527 ts_tablet_manager.cc:1403] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.008s
I20260709 12:15:27.126267  8525 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:27.130411  8526 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:27.131036  8526 ts_tablet_manager.cc:1403] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.207s	user 0.010s	sys 0.017s
I20260709 12:15:27.131265  8527 raft_consensus.cc:359] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.131971  8527 raft_consensus.cc:385] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.132231  8527 raft_consensus.cc:740] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.132884  8527 consensus_queue.cc:260] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.133364  8526 raft_consensus.cc:359] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.134069  8526 raft_consensus.cc:385] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.134243  8526 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.134815  8526 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.141247  8526 ts_tablet_manager.cc:1434] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:15:27.142338  8526 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:27.147210  8527 ts_tablet_manager.cc:1434] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:15:27.148118  8528 tablet_bootstrap.cc:654] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.148309  8527 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:27.155263  8566 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.155884  8566 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.157811  8527 tablet_bootstrap.cc:654] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.163487  8526 tablet_bootstrap.cc:654] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.165184  8566 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.166962  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.167780  8331 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:27.168560  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:27.171238  8222 leader_election.cc:343] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.180433  8525 tablet_bootstrap.cc:654] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.181756  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:27.186865  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:27.190378  8566 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.190862  8566 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.191347  8566 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.193620  8402 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.203120  8527 tablet_bootstrap.cc:492] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.203953  8527 ts_tablet_manager.cc:1403] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.002s
I20260709 12:15:27.206876  8579 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:27.207563  8579 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.209924  8579 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.211190  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.212210  8331 raft_consensus.cc:2393] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:27.214607  8681 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.217387  8681 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.219606  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.220436  8480 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:27.222152  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.223230  8720 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:27.223627  8720 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:27.224028  8720 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:27.226097  8527 raft_consensus.cc:359] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.232002  8527 raft_consensus.cc:385] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.232492  8527 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.233351  8527 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.232002  8525 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:27.228261  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.234534  8525 ts_tablet_manager.cc:1403] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.008s
I20260709 12:15:27.234813  8480 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:27.231205  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.226719  8681 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.237489  8220 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.238561  8527 ts_tablet_manager.cc:1434] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:15:27.238752  8681 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.239845  8527 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:27.245425  8525 raft_consensus.cc:359] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.246348  8525 raft_consensus.cc:385] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.246698  8525 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.250203  8525 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.254771  8525 ts_tablet_manager.cc:1434] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:15:27.261965  8566 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.265987  8527 tablet_bootstrap.cc:654] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.267171  8681 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.267849  8720 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.269589  8528 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:27.270145  8528 ts_tablet_manager.cc:1403] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.007s
I20260709 12:15:27.272920  8525 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:27.273923  8720 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.275799  8739 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:27.276258  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:27.280262  8525 tablet_bootstrap.cc:654] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.289152  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:27.290406  8331 raft_consensus.cc:2393] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:27.292320  8566 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.293597  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:27.293891  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:27.294337  8402 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.295264  8480 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:27.296839  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.297006  8331 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.298036  8528 raft_consensus.cc:359] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.298817  8528 raft_consensus.cc:385] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.299160  8528 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.299933  8528 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.299253  8720 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:27.305560  8405 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.308820  8720 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:27.310209  8720 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.320924  8526 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:27.321570  8526 ts_tablet_manager.cc:1403] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.179s	user 0.023s	sys 0.014s
I20260709 12:15:27.338969  8681 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.339186  8561 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.339607  8681 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.342593  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.343200  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:27.343396  8332 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
W20260709 12:15:27.344839  8222 leader_election.cc:343] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.345501  8220 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:27.346505  8579 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.346918  8579 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.347322  8579 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.347468  8527 tablet_bootstrap.cc:492] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.348029  8527 ts_tablet_manager.cc:1403] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.007s
I20260709 12:15:27.322949  8331 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:27.354574  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:27.355783  8566 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.324793  8526 raft_consensus.cc:359] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.333870  8757 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.361207  8757 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.345526  8681 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.362838  8720 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.330569  8528 ts_tablet_manager.cc:1434] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 12:15:27.363121  8668 consensus_queue.cc:1048] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:15:27.372766  8528 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:27.375891  8579 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.360530  8526 raft_consensus.cc:385] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.379573  8579 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.368299  8527 raft_consensus.cc:359] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.370172  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.380543  8526 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.371083  8566 raft_consensus.cc:697] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:27.366591  8757 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:27.381711  8526 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.381541  8154 catalog_manager.cc:5697] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 1 to 2, leader changed from 35617b9c10ad4daa80878f0de881422c (127.3.34.196) to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.380049  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:27.381950  8566 consensus_queue.cc:237] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.328953  8402 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:27.388288  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:27.388931  8527 raft_consensus.cc:385] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.389011  8332 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:27.391297  8222 leader_election.cc:343] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.393862  8526 ts_tablet_manager.cc:1434] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:15:27.394979  8526 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:27.399266  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.370518  8525 tablet_bootstrap.cc:492] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:27.401518  8525 ts_tablet_manager.cc:1403] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.005s
I20260709 12:15:27.402812  8369 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.409149  8332 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:27.413280  8220 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:27.409938  8527 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.415468  8579 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.417997  8642 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:27.416113  8527 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.418366  8579 raft_consensus.cc:697] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:27.418283  8528 tablet_bootstrap.cc:654] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:27.424726  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 68825.1us
I20260709 12:15:27.423532  8579 consensus_queue.cc:237] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.425076  8527 ts_tablet_manager.cc:1434] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 12:15:27.429980  8527 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:27.416296  8525 raft_consensus.cc:359] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.433759  8525 raft_consensus.cc:385] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.434199  8525 raft_consensus.cc:740] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.435329  8525 consensus_queue.cc:260] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.442898  8525 ts_tablet_manager.cc:1434] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:15:27.438832  8526 tablet_bootstrap.cc:654] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.446165  8642 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.450855  8528 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:27.453364  8525 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:27.457114  8528 ts_tablet_manager.cc:1403] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.000s
I20260709 12:15:27.475791  8681 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.476790  8528 raft_consensus.cc:359] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.477632  8528 raft_consensus.cc:385] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.477944  8528 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.480616  8528 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.487998  8527 tablet_bootstrap.cc:654] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.488767  8528 ts_tablet_manager.cc:1434] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:15:27.490306  8528 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:27.498812  8525 tablet_bootstrap.cc:654] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.519537  8668 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.520215  8668 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.526010  8668 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:27.528273  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.529098  8331 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:27.532745  8369 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:27.535334  8668 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.535808  8668 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.536217  8668 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.544041  8689 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.544706  8689 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.550268  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.551158  8480 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:27.561311  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:27.566794  8689 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:27.568214  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:27.569851  8446 leader_election.cc:343] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:27.575353  8445 leader_election.cc:343] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.575906  8445 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:27.592034  8739 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.607908  8528 tablet_bootstrap.cc:654] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.609045  8527 tablet_bootstrap.cc:492] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.609794  8527 ts_tablet_manager.cc:1403] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.004s
I20260709 12:15:27.613937  8526 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
W20260709 12:15:27.607116  8781 log.cc:927] Time spent T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:15:27.614703  8526 ts_tablet_manager.cc:1403] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.014s
I20260709 12:15:27.610893  8757 raft_consensus.cc:2749] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:27.625355  8757 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.625964  8757 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.624802  8526 raft_consensus.cc:359] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:27.630411  8786 log.cc:927] Time spent T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:15:27.631102  8526 raft_consensus.cc:385] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.632803  8526 raft_consensus.cc:740] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.633836  8561 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.634404  8561 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.635682  8526 consensus_queue.cc:260] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.656734  8154 catalog_manager.cc:5697] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.661022  8526 ts_tablet_manager.cc:1434] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.011s
I20260709 12:15:27.662389  8526 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:27.670338  8525 tablet_bootstrap.cc:492] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:27.670956  8525 ts_tablet_manager.cc:1403] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.016s
I20260709 12:15:27.674880  8527 raft_consensus.cc:359] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.678699  8527 raft_consensus.cc:385] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.679396  8527 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.683393  8757 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:27.675664  8778 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.691464  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.691399  8778 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.693105  8527 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.691709  8668 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.695115  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:27.696143  8668 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:27.701051  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:27.697101  8525 raft_consensus.cc:359] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.702544  8331 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.702911  8525 raft_consensus.cc:385] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.704070  8525 raft_consensus.cc:740] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.700135  8778 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:27.697162  8445 leader_election.cc:343] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.701344  8527 ts_tablet_manager.cc:1434] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.003s
I20260709 12:15:27.709506  8525 consensus_queue.cc:260] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.715020  8527 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:27.707180  8561 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.723651  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.725200  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:27.725400  8478 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:27.725953  8257 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
W20260709 12:15:27.712883  8443 leader_election.cc:343] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.728806  8525 ts_tablet_manager.cc:1434] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
W20260709 12:15:27.729971  8789 log.cc:927] Time spent T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:15:27.721910  8794 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.733805  8525 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:27.735350  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:27.736135  8479 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.736737  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:27.737493  8404 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:27.739735  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.740545  8480 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:27.742132  8221 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:27.743729  8681 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.744160  8681 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.744588  8681 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.744779  8331 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:27.745891  8372 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:27.750123  8369 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:27.751616  8526 tablet_bootstrap.cc:654] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.752794  8525 tablet_bootstrap.cc:654] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.753604  8443 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:27.754565  8689 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.757995  8668 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.758510  8668 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.758555  8791 consensus_queue.cc:1048] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.759126  8668 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.759688  8793 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:27.760449  8793 raft_consensus.cc:697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:27.761409  8793 consensus_queue.cc:237] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:27.764894  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 64025.6us
I20260709 12:15:27.734721  8794 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.770391  8794 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.772572  8528 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:27.773177  8528 ts_tablet_manager.cc:1403] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.283s	user 0.020s	sys 0.009s
I20260709 12:15:27.775079  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.776003  8332 raft_consensus.cc:2393] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:27.776497  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:27.778820  8372 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.780653  8795 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.782524  8688 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.783151  8688 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.784441  8479 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:27.785487  8528 raft_consensus.cc:359] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.795750  8528 raft_consensus.cc:385] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.796087  8528 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.796852  8528 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.787673  8688 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:27.799667  8528 ts_tablet_manager.cc:1434] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 12:15:27.788024  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.800318  8480 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:27.801499  8296 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:27.802192  8528 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:27.805210  8688 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:27.805872  8688 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.806381  8688 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:27.809734  8528 tablet_bootstrap.cc:654] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.820174  8689 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.820824  8689 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.790382  8681 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.789284  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:27.809473  8795 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.812419  8526 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:27.828452  8526 ts_tablet_manager.cc:1403] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.006s
I20260709 12:15:27.831492  8681 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:27.832933  8689 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.786820  8668 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.795018  8527 tablet_bootstrap.cc:654] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:27.835862  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:27.826556  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:27.838438  8526 raft_consensus.cc:359] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:27.837786  8443 leader_election.cc:343] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.839679  8526 raft_consensus.cc:385] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:27.842161  8446 leader_election.cc:343] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.842860  8446 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:27.843974  8152 catalog_manager.cc:5697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.848060  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:27.849992  8405 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:27.811846  8778 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:27.852757  8689 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.840570  8526 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.855324  8688 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:27.858345  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 59272.5us
I20260709 12:15:27.859055  8526 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:27.898195  8525 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:27.901496  8525 ts_tablet_manager.cc:1403] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.169s	user 0.032s	sys 0.020s
I20260709 12:15:27.864444  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:27.903954  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:27.860996  8688 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:27.904675  8480 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:27.904247  8154 catalog_manager.cc:5697] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:27.906558  8525 raft_consensus.cc:359] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.907433  8525 raft_consensus.cc:385] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.907749  8525 raft_consensus.cc:740] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.908468  8525 consensus_queue.cc:260] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.904680  8257 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:27.913425  8525 ts_tablet_manager.cc:1434] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:27.914254  8480 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:27.914672  8525 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:27.865495  8332 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:27.924376  8526 ts_tablet_manager.cc:1434] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.001s
I20260709 12:15:27.855238  8668 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:27.927165  8526 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:27.865065  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:27.898182  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:27.886765  8778 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.940181  8778 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.863152  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:27.942400  8478 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.950682  8528 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:27.951769  8528 ts_tablet_manager.cc:1403] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.150s	user 0.035s	sys 0.032s
I20260709 12:15:27.954434  8480 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:27.955276  8720 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:15:27.961447  8527 tablet_bootstrap.cc:492] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:27.962590  8527 ts_tablet_manager.cc:1403] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.000s
I20260709 12:15:27.966034  8779 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:15:27.967079  8579 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:27.967454  8579 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:27.971573  8779 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:27.972363  8221 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:27.973345  8720 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:27.973757  8800 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.974268  8800 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:27.976487  8800 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:27.968389  8579 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:27.977986  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:27.982548  8445 leader_election.cc:343] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:27.983796  8579 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:27.986128  8778 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:27.978368  8720 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:27.984812  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:27.987178  8479 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:27.988385  8221 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:27.988775  8779 consensus_queue.cc:1175] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35617b9c10ad4daa80878f0de881422c" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:27.989569  8778 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:27.989974  8778 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.990340  8778 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:27.988417  8528 raft_consensus.cc:359] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.992787  8528 raft_consensus.cc:385] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.993399  8528 raft_consensus.cc:740] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:27.996651  8527 raft_consensus.cc:359] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:27.997483  8527 raft_consensus.cc:385] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:27.997798  8527 raft_consensus.cc:740] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.017853  8526 tablet_bootstrap.cc:654] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.020025  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:28.020105  8642 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.021500  8642 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.024084  8642 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:28.014238  8525 tablet_bootstrap.cc:654] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.027469  8528 consensus_queue.cc:260] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.003537  8695 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.031086  8695 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.032979  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:28.002506  8527 consensus_queue.cc:260] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.022730  8478 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:28.047425  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:28.048717  8297 leader_election.cc:343] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.051047  8528 ts_tablet_manager.cc:1434] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:15:28.052558  8528 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
W20260709 12:15:28.053798  8298 leader_election.cc:343] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.054407  8298 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:28.028981  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 112061us
I20260709 12:15:28.063185  8647 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.060762  8720 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.067932  8720 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.069464  8527 ts_tablet_manager.cc:1434] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 12:15:28.070521  8527 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:28.072620  8332 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:28.087723  8296 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:28.088855  8647 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:28.089413  8647 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:28.090418  8647 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.091131  8695 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:28.087177  8720 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:28.107036  8808 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.107632  8808 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.099807  8370 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:28.122179  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:28.122772  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:28.124198  8446 leader_election.cc:343] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.126178  8795 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.126816  8795 raft_consensus.cc:697] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:28.128064  8795 consensus_queue.cc:237] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.129238  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:28.131855  8445 leader_election.cc:343] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.132380  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:28.134086  8804 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.124337  8527 tablet_bootstrap.cc:654] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.126762  8525 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:28.136333  8525 ts_tablet_manager.cc:1403] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.222s	user 0.020s	sys 0.004s
I20260709 12:15:28.140502  8525 raft_consensus.cc:359] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.141285  8525 raft_consensus.cc:385] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.141546  8525 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.142127  8525 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.156592  8525 ts_tablet_manager.cc:1434] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:15:28.161347  8525 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:28.118954  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:28.115794  8808 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:28.174175  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:28.175141  8778 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.170253  8403 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:28.178946  8526 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:28.185526  8526 ts_tablet_manager.cc:1403] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.259s	user 0.014s	sys 0.011s
I20260709 12:15:28.182709  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:28.182157  8668 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:15:28.196388  8478 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:28.179553  8480 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:28.182765  8778 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:28.181674  8443 leader_election.cc:343] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.198858  8526 raft_consensus.cc:359] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.200666  8443 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:28.199733  8528 tablet_bootstrap.cc:654] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.200948  8526 raft_consensus.cc:385] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.203218  8526 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.204017  8526 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.254092  8152 catalog_manager.cc:5697] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:28.258773  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 126400us
I20260709 12:15:28.260207  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:28.260502  8221 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:28.262465  8257 raft_consensus.cc:2393] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:28.276062  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 94209.8us
I20260709 12:15:28.286161  8561 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.293664  8526 ts_tablet_manager.cc:1434] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.003s
I20260709 12:15:28.302906  8527 tablet_bootstrap.cc:492] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:28.342782  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:28.350036  8480 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.349651  8794 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.354838  8525 tablet_bootstrap.cc:654] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.304422  8695 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.358376  8695 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.360931  8778 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.361756  8778 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.362110  8526 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:28.362246  8778 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:28.371433  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 44630.1us
I20260709 12:15:28.381485  8527 ts_tablet_manager.cc:1403] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.311s	user 0.014s	sys 0.006s
I20260709 12:15:28.397966  8528 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:28.399042  8528 ts_tablet_manager.cc:1403] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.347s	user 0.019s	sys 0.002s
W20260709 12:15:28.403625  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 94676.2us
I20260709 12:15:28.411729  8527 raft_consensus.cc:359] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.415889  8527 raft_consensus.cc:385] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.420334  8154 catalog_manager.cc:5697] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 2 to 3, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:28.418082  8527 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.439110  8527 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.433054  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:28.447901  8695 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:28.471495  8778 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.471796  8527 ts_tablet_manager.cc:1434] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.002s
W20260709 12:15:28.450881  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 81033.8us
I20260709 12:15:28.430884  8480 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:28.462769  8403 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:28.475790  8528 raft_consensus.cc:359] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.485388  8528 raft_consensus.cc:385] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.485885  8528 raft_consensus.cc:740] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.489384  8527 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:28.491173  8526 tablet_bootstrap.cc:654] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.494575  8296 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:28.503546  8297 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:28.504916  8695 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.505548  8695 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.506075  8695 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.529066  8688 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.529678  8688 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.530092  8688 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.537178  8256 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:28.537846  8256 pending_rounds.cc:85] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Aborting all ops after (but not including) 1
I20260709 12:15:28.538079  8778 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:28.538249  8256 pending_rounds.cc:107] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:28.543774  8528 consensus_queue.cc:260] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.547505  8525 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:28.550189  8779 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.540198  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:28.562266  8525 ts_tablet_manager.cc:1403] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.403s	user 0.018s	sys 0.010s
I20260709 12:15:28.563517  8779 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.566121  8525 raft_consensus.cc:359] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.567185  8525 raft_consensus.cc:385] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.567552  8525 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.568321  8525 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.573521  8525 ts_tablet_manager.cc:1434] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:15:28.574177  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:28.575218  8405 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.576146  8525 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:28.578907  8528 ts_tablet_manager.cc:1434] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.179s	user 0.008s	sys 0.002s
I20260709 12:15:28.580534  8528 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:28.587580  8221 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:28.589422  8822 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.590245  8822 raft_consensus.cc:697] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:28.591352  8822 consensus_queue.cc:237] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.592868  8695 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.599328  8525 tablet_bootstrap.cc:654] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.557271  8256 raft_consensus.cc:2889] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:28.612488  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:28.613325  8403 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.614032  8405 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:28.616218  8795 consensus_queue.cc:1048] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.616570  8222 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:28.618017  8824 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.618664  8824 raft_consensus.cc:697] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:28.619879  8824 consensus_queue.cc:237] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.618080  8779 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:28.624136  8810 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:28.622843  8527 tablet_bootstrap.cc:654] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.622828  8688 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.637549  8526 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:28.638150  8526 ts_tablet_manager.cc:1403] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.277s	user 0.042s	sys 0.015s
I20260709 12:15:28.646381  8332 raft_consensus.cc:2393] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:28.646533  8695 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:28.649876  8526 raft_consensus.cc:359] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.655566  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:28.657043  8528 tablet_bootstrap.cc:654] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.657162  8526 raft_consensus.cc:385] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.657968  8526 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.660595  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:28.661585  8475 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:28.662760  8808 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.663528  8808 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.666472  8808 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:28.668238  8479 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.668720  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:28.671928  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:28.672135  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:28.676082  8443 leader_election.cc:343] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.678007  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:28.680217  8446 leader_election.cc:343] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.680748  8446 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:28.682873  8800 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.686374  8403 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:28.688727  8152 catalog_manager.cc:5697] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.691867  8688 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:28.696306  8221 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:28.696377  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:28.697579  8814 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.698057  8814 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.698491  8814 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.697602  8476 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:28.733333  8476 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:28.734730  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:28.735605  8475 raft_consensus.cc:2393] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:28.727999  8297 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:28.733436  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:28.743935  8478 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.740267  8688 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.747525  8688 raft_consensus.cc:697] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:28.748755  8688 consensus_queue.cc:237] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:28.759233  8526 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:28.764096  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:28.771348  8779 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.782362  8479 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:28.779891  8779 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.788324  8526 ts_tablet_manager.cc:1434] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.150s	user 0.004s	sys 0.006s
I20260709 12:15:28.788730  8814 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.789580  8526 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:28.791712  8478 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:28.793372  8814 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:28.806471  8528 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:28.807087  8528 ts_tablet_manager.cc:1403] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.034s
W20260709 12:15:28.809792  8220 leader_election.cc:343] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:28.810766  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 46318.6us
I20260709 12:15:28.812897  8668 consensus_queue.cc:1048] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:28.818892  8154 catalog_manager.cc:5697] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:28.821626  8779 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:28.824741  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:28.826614  8222 leader_election.cc:343] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.827055  8528 raft_consensus.cc:359] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.827930  8528 raft_consensus.cc:385] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.828279  8528 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.833676  8527 tablet_bootstrap.cc:492] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:28.834250  8527 ts_tablet_manager.cc:1403] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.345s	user 0.044s	sys 0.034s
I20260709 12:15:28.835768  8525 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:28.837373  8525 ts_tablet_manager.cc:1403] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.262s	user 0.025s	sys 0.003s
I20260709 12:15:28.797762  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:28.845129  8525 raft_consensus.cc:359] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.846053  8525 raft_consensus.cc:385] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.846400  8525 raft_consensus.cc:740] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.847198  8525 consensus_queue.cc:260] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.849607  8527 raft_consensus.cc:359] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.850720  8527 raft_consensus.cc:385] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.851034  8527 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.851783  8527 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.853578  8688 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.841004  8528 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.855829  8688 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:28.853581  8152 catalog_manager.cc:5697] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.865551  8688 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:28.867441  8688 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:28.866261  8478 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.869053  8525 ts_tablet_manager.cc:1434] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:15:28.870038  8527 ts_tablet_manager.cc:1434] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:15:28.860798  8296 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:28.871466  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:28.884967  8527 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:28.875450  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:28.886266  8297 leader_election.cc:343] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.887306  8642 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:15:28.888109  8298 leader_election.cc:343] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.888695  8298 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:28.889937  8528 ts_tablet_manager.cc:1434] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:15:28.890347  8695 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.891324  8528 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:28.895871  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:28.897219  8808 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.897677  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:28.897756  8808 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:28.898697  8328 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:28.901306  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:28.902872  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:28.903012  8446 leader_election.cc:343] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:28.905092  8445 leader_election.cc:343] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.905555  8445 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:28.907368  8800 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.909379  8808 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:28.912010  8525 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:28.896865  8478 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:28.917045  8527 tablet_bootstrap.cc:654] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.865869  8526 tablet_bootstrap.cc:654] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:28.917899  8220 leader_election.cc:343] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:28.921149  8221 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:28.922206  8579 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:28.922785  8579 raft_consensus.cc:697] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:28.939708  8528 tablet_bootstrap.cc:654] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.942482  8525 tablet_bootstrap.cc:654] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.923978  8579 consensus_queue.cc:237] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.939610  8526 tablet_bootstrap.cc:492] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:28.945106  8526 ts_tablet_manager.cc:1403] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.003s
I20260709 12:15:28.923310  8220 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:28.954663  8525 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:28.954258  8526 raft_consensus.cc:359] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.955304  8526 raft_consensus.cc:385] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.955639  8526 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.955793  8779 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:28.956250  8779 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.956570  8779 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.956923  8526 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.961040  8526 ts_tablet_manager.cc:1434] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:15:28.963402  8525 ts_tablet_manager.cc:1403] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.007s
I20260709 12:15:28.965883  8779 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:28.967063  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 43910.8us
I20260709 12:15:28.967722  8525 raft_consensus.cc:359] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.962751  8526 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:28.971211  8525 raft_consensus.cc:385] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.971562  8525 raft_consensus.cc:740] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.971588  8528 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:28.972371  8528 ts_tablet_manager.cc:1403] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.011s
I20260709 12:15:28.972702  8525 consensus_queue.cc:260] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.975075  8525 ts_tablet_manager.cc:1434] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:15:28.976075  8525 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:28.975854  8528 raft_consensus.cc:359] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:28.976801  8528 raft_consensus.cc:385] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.977475  8528 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.981582  8526 tablet_bootstrap.cc:654] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.982161  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:28.982918  8328 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.989337  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:28.990298  8403 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.991689  8525 tablet_bootstrap.cc:654] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:28.992439  8154 catalog_manager.cc:5697] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:28.994578  8779 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.019349  8566 consensus_queue.cc:1048] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.022935  8566 consensus_queue.cc:1048] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.042059  8328 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:28.978406  8528 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.053541  8778 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.079126  8778 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.080416  8220 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:29.081343  8823 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.081471  8778 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.061209  8779 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.082329  8779 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.083491  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.084564  8779 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:29.085326  8220 leader_election.cc:343] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.075860  8403 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:29.081859  8823 raft_consensus.cc:697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:29.068387  8566 consensus_queue.cc:1048] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.086710  8823 consensus_queue.cc:237] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.079160  8800 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.088181  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.087986  8800 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.092973  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.093771  8479 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.094090  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:29.094278  8222 leader_election.cc:343] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.095218  8221 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:29.097522  8446 leader_election.cc:343] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.098608  8579 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.099062  8579 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.099399  8579 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.099514  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.100554  8480 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.102421  8221 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:29.107446  8778 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.108779  8778 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.109103  8778 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.094135  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:29.111699  8443 leader_election.cc:343] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.112135  8443 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:29.112965  8808 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.125957  8579 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.128979  8814 consensus_queue.cc:1048] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.130749  8527 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:29.104415  8800 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.131337  8527 ts_tablet_manager.cc:1403] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.247s	user 0.034s	sys 0.025s
I20260709 12:15:29.142051  8579 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:29.140939  8528 ts_tablet_manager.cc:1434] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.168s	user 0.010s	sys 0.000s
I20260709 12:15:29.152006  8525 tablet_bootstrap.cc:492] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.152819  8525 ts_tablet_manager.cc:1403] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.177s	user 0.029s	sys 0.026s
I20260709 12:15:29.157017  8525 raft_consensus.cc:359] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.158015  8525 raft_consensus.cc:385] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.158388  8525 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.158597  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:29.159585  8525 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:29.160004  8222 leader_election.cc:343] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.162568  8525 ts_tablet_manager.cc:1434] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:29.164426  8525 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.165172  8778 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.168954  8526 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:29.169339  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:29.166698  8152 catalog_manager.cc:5697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.170015  8480 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.171562  8525 tablet_bootstrap.cc:654] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.173136  8528 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:29.164485  8527 raft_consensus.cc:359] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.177537  8527 raft_consensus.cc:385] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.177850  8527 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.169552  8526 ts_tablet_manager.cc:1403] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.207s	user 0.043s	sys 0.068s
I20260709 12:15:29.179041  8480 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:29.197167  8221 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.200189  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:29.202699  8526 raft_consensus.cc:359] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.203441  8823 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.203775  8526 raft_consensus.cc:385] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.204043  8823 raft_consensus.cc:697] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:29.204169  8526 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.205128  8823 consensus_queue.cc:237] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:29.205783  8220 leader_election.cc:343] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.183993  8527 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.208180  8527 ts_tablet_manager.cc:1434] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.076s	user 0.001s	sys 0.006s
I20260709 12:15:29.208597  8526 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.209379  8527 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:29.185016  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:29.211700  8478 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.195815  8778 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.227537  8695 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.228389  8695 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.229192  8528 tablet_bootstrap.cc:654] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.233178  8478 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:29.235491  8695 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:29.235666  8527 tablet_bootstrap.cc:654] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.236042  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:29.237802  8221 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:29.238729  8778 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.239289  8778 raft_consensus.cc:697] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:29.240383  8778 consensus_queue.cc:237] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.246580  8526 ts_tablet_manager.cc:1434] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 12:15:29.252108  8528 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:29.254151  8528 ts_tablet_manager.cc:1403] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.001s
I20260709 12:15:29.256939  8528 raft_consensus.cc:359] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.257551  8528 raft_consensus.cc:385] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.257802  8528 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.253561  8526 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:29.253000  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.261518  8480 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:29.263031  8296 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:29.263609  8525 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.264142  8525 ts_tablet_manager.cc:1403] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.100s	user 0.033s	sys 0.043s
I20260709 12:15:29.264612  8695 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.258450  8528 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.266921  8525 raft_consensus.cc:359] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.267635  8525 raft_consensus.cc:385] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.267879  8525 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.268605  8525 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.271286  8525 ts_tablet_manager.cc:1434] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:15:29.272316  8525 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.268210  8528 ts_tablet_manager.cc:1434] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 12:15:29.274451  8528 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:29.280467  8528 tablet_bootstrap.cc:654] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.280998  8695 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.285513  8525 tablet_bootstrap.cc:654] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.295341  8526 tablet_bootstrap.cc:654] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.295418  8527 tablet_bootstrap.cc:492] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:29.296342  8527 ts_tablet_manager.cc:1403] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.005s
I20260709 12:15:29.299173  8527 raft_consensus.cc:359] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.299866  8527 raft_consensus.cc:385] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.300130  8527 raft_consensus.cc:740] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.300875  8527 consensus_queue.cc:260] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.303512  8527 ts_tablet_manager.cc:1434] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:29.303107  8695 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.303138  8154 catalog_manager.cc:5697] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.305378  8154 catalog_manager.cc:5697] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.312047  8525 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.313817  8525 ts_tablet_manager.cc:1403] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.009s
I20260709 12:15:29.317994  8525 raft_consensus.cc:359] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.318665  8525 raft_consensus.cc:385] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.318938  8525 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.320009  8527 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:29.319644  8525 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.322247  8525 ts_tablet_manager.cc:1434] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:29.323352  8525 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.329618  8527 tablet_bootstrap.cc:654] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.329782  8525 tablet_bootstrap.cc:654] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.343008  8526 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:29.343617  8526 ts_tablet_manager.cc:1403] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.004s
I20260709 12:15:29.349481  8528 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:29.349651  8525 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.350172  8528 ts_tablet_manager.cc:1403] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.008s
I20260709 12:15:29.350190  8525 ts_tablet_manager.cc:1403] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 12:15:29.353384  8525 raft_consensus.cc:359] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.353648  8528 raft_consensus.cc:359] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.354317  8525 raft_consensus.cc:385] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.354393  8528 raft_consensus.cc:385] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.351377  8526 raft_consensus.cc:359] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.354714  8525 raft_consensus.cc:740] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.355260  8526 raft_consensus.cc:385] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.355643  8526 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.354779  8528 raft_consensus.cc:740] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.355875  8525 consensus_queue.cc:260] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.356763  8528 consensus_queue.cc:260] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.358906  8525 ts_tablet_manager.cc:1434] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:29.364643  8525 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.365881  8528 ts_tablet_manager.cc:1434] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:15:29.367170  8528 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:29.370965  8525 tablet_bootstrap.cc:654] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.373347  8695 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:29.376196  8528 tablet_bootstrap.cc:654] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.379628  8794 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.380172  8794 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.390168  8794 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:29.394690  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:29.397322  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.398092  8480 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:29.404474  8372 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:29.407778  8794 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.429618  8525 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.430199  8525 ts_tablet_manager.cc:1403] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.011s
I20260709 12:15:29.440511  8525 raft_consensus.cc:359] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.441355  8525 raft_consensus.cc:385] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.441707  8525 raft_consensus.cc:740] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.448107  8794 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.450472  8526 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.451915  8527 tablet_bootstrap.cc:492] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:29.452474  8527 ts_tablet_manager.cc:1403] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.133s	user 0.057s	sys 0.041s
I20260709 12:15:29.453048  8526 ts_tablet_manager.cc:1434] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.000s
I20260709 12:15:29.455891  8527 raft_consensus.cc:359] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.456712  8527 raft_consensus.cc:385] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.457001  8527 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.457682  8527 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.460004  8778 consensus_queue.cc:1048] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:29.468459  8526 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:29.442462  8525 consensus_queue.cc:260] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.476958  8525 ts_tablet_manager.cc:1434] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:15:29.487877  8525 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.489449  8824 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.490233  8824 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.494623  8525 tablet_bootstrap.cc:654] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.500414  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.502048  8579 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:29.503053  8222 leader_election.cc:343] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.502818  8579 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.496657  8824 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.506067  8579 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.514744  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.515368  8800 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.515621  8406 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.515957  8800 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.518805  8222 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:29.520839  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.519466  8800 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.522019  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.524763  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:29.522182  8445 leader_election.cc:343] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.525436  8332 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
W20260709 12:15:29.525799  8443 leader_election.cc:343] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.526257  8443 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.526932  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.527228  8808 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.527643  8332 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.528888  8695 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.529469  8695 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.519109  8869 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.536640  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.535187  8579 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.538704  8579 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.540995  8579 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:29.544935  8297 leader_election.cc:343] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.547916  8824 consensus_queue.cc:1048] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.549861  8566 consensus_queue.cc:1048] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.536051  8695 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.534884  8869 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.575258  8220 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.577356  8823 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.578012  8823 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.582037  8823 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.583840  8525 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.585280  8525 ts_tablet_manager.cc:1403] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.002s
I20260709 12:15:29.589213  8525 raft_consensus.cc:359] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.592036  8525 raft_consensus.cc:385] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.592762  8525 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.594278  8525 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.596374  8525 ts_tablet_manager.cc:1434] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:15:29.597430  8525 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:29.554215  8526 tablet_bootstrap.cc:654] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.607980  8869 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.608152  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.608974  8332 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:29.615121  8642 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.615633  8642 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.619268  8528 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:29.619822  8528 ts_tablet_manager.cc:1403] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.253s	user 0.030s	sys 0.024s
I20260709 12:15:29.620831  8369 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:29.637717  8527 ts_tablet_manager.cc:1434] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.185s	user 0.060s	sys 0.079s
I20260709 12:15:29.639183  8527 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:29.621793  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:29.646972  8528 raft_consensus.cc:359] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.647680  8528 raft_consensus.cc:385] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.647972  8528 raft_consensus.cc:740] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.648682  8528 consensus_queue.cc:260] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.651816  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:29.642796  8779 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.652921  8779 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.653776  8778 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.654314  8778 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.655177  8566 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.655905  8566 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:29.660048  8642 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:29.658612  8566 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:29.672441  8528 ts_tablet_manager.cc:1434] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:15:29.683507  8779 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.688972  8778 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.689608  8823 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.688489  8579 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.697615  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.698436  8257 raft_consensus.cc:2393] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:29.734735  8255 raft_consensus.cc:2393] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:29.698690  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.700039  8878 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:29.735826  8222 leader_election.cc:343] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.736034  8878 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:29.703137  8220 consensus_peers.cc:597] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Couldn't send request to peer 70ae764f2abd44229023295f5cc6bf37. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:29.736470  8878 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:29.736610  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 74282.4us
I20260709 12:15:29.739126  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.741611  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:29.742058  8808 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.742802  8808 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:29.746888  8220 leader_election.cc:343] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.746829  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:29.747977  8220 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.749181  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:29.749517  8445 leader_election.cc:343] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.749953  8332 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.750043  8878 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:29.749198  8298 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.707147  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:29.755456  8405 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:29.708619  8779 consensus_queue.cc:1048] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.756592  8808 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:29.757776  8779 consensus_queue.cc:1048] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:29.710502  8528 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:29.763585  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:29.763825  8297 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:29.764392  8327 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.764853  8695 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.765350  8695 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.765762  8695 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:29.773487  8222 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.774255  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.730712  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:29.778909  8566 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:29.779369  8327 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:29.780820  8369 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:29.782006  8869 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:29.782552  8869 raft_consensus.cc:697] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:29.783500  8869 consensus_queue.cc:237] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:29.785808  8222 leader_election.cc:343] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:29.719483  8525 tablet_bootstrap.cc:654] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.754416  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:29.789901  8256 raft_consensus.cc:2468] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:29.791849  8446 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:29.774340  8878 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:29.733368  8823 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.793046  8808 raft_consensus.cc:2804] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:29.804798  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.813678  8480 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:29.813401  8808 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.834121  8808 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:29.835898  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:29.813127  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:29.863885  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.864718  8480 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.800514  8695 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:29.834978  8579 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:29.878566  8255 raft_consensus.cc:2393] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:29.883450  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:29.886232  8480 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:29.904790  8528 tablet_bootstrap.cc:654] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:29.918881  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 89020.1us
I20260709 12:15:29.924679  8526 tablet_bootstrap.cc:492] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:29.925516  8526 ts_tablet_manager.cc:1403] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.471s	user 0.072s	sys 0.064s
I20260709 12:15:29.922791  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:29.955955  8882 log.cc:927] Time spent T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:15:29.965320  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:29.965986  8402 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.967823  8695 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:29.950560  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:29.977391  8525 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:29.978087  8525 ts_tablet_manager.cc:1403] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.381s	user 0.020s	sys 0.018s
I20260709 12:15:29.980749  8527 tablet_bootstrap.cc:654] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:29.980854  8332 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:29.982206  8328 raft_consensus.cc:2393] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:29.985364  8526 raft_consensus.cc:359] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:29.986169  8526 raft_consensus.cc:385] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:29.986452  8526 raft_consensus.cc:740] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:29.990346  8526 consensus_queue.cc:260] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:29.992178  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 47220.5us
I20260709 12:15:30.007865  8220 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.009925  8778 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.010522  8778 raft_consensus.cc:697] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:30.011584  8778 consensus_queue.cc:237] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:30.013824  8526 ts_tablet_manager.cc:1434] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 12:15:29.989826  8642 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.025776  8525 raft_consensus.cc:359] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.026953  8525 raft_consensus.cc:385] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.033977  8402 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:30.027324  8525 raft_consensus.cc:740] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.048810  8525 consensus_queue.cc:260] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.051733  8526 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:30.062915  8222 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.063803  8808 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.064358  8525 ts_tablet_manager.cc:1434] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 12:15:30.065554  8525 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:30.066198  8808 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:30.067325  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:30.067986  8480 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.068192  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:30.068881  8255 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.070245  8814 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.078574  8297 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:30.090955  8480 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:30.095614  8528 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:30.097592  8528 ts_tablet_manager.cc:1403] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.387s	user 0.017s	sys 0.016s
I20260709 12:15:30.095255  8642 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.100054  8642 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:30.100978  8642 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.101069  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:30.104704  8445 leader_election.cc:343] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.117479  8525 tablet_bootstrap.cc:654] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.117815  8255 raft_consensus.cc:2468] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:30.123493  8808 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.124112  8808 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.125119  8446 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.126619  8808 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:30.127512  8808 raft_consensus.cc:2804] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.128562  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:30.131479  8808 raft_consensus.cc:697] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:30.132465  8808 consensus_queue.cc:237] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:30.133693  8445 leader_election.cc:343] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.140694  8329 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.141371  8152 catalog_manager.cc:5697] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 1 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.156702  8526 tablet_bootstrap.cc:654] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.158696  8528 raft_consensus.cc:359] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.163993  8528 raft_consensus.cc:385] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.164299  8528 raft_consensus.cc:740] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.169869  8528 consensus_queue.cc:260] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.189100  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:30.193037  8443 leader_election.cc:343] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.193655  8443 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.208065  8528 ts_tablet_manager.cc:1434] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.001s
I20260709 12:15:30.211531  8872 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.218448  8800 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:30.224951  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 241838us
I20260709 12:15:30.225957  8221 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.227062  8579 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.227579  8579 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.227901  8579 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.278376  8528 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:30.274981  8579 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:30.276113  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 50267.2us
I20260709 12:15:30.302721  8525 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:30.303571  8525 ts_tablet_manager.cc:1403] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.002s
I20260709 12:15:30.334502  8526 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:30.335129  8526 ts_tablet_manager.cc:1403] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.284s	user 0.011s	sys 0.003s
I20260709 12:15:30.325503  8896 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.309649  8221 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:30.340227  8896 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.345310  8579 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:30.351228  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:30.352133  8579 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.355178  8579 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.355597  8579 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:30.356379  8222 leader_election.cc:343] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:30.352798  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 47234.2us
I20260709 12:15:30.352672  8869 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.363278  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:30.366071  8527 tablet_bootstrap.cc:492] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:30.366755  8527 ts_tablet_manager.cc:1403] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.728s	user 0.051s	sys 0.063s
W20260709 12:15:30.368713  8446 leader_election.cc:343] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.369097  8896 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:30.370494  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:30.372110  8443 leader_election.cc:343] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.372511  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:30.373026  8528 tablet_bootstrap.cc:654] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.373999  8896 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:30.376408  8526 raft_consensus.cc:359] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.379722  8526 raft_consensus.cc:385] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.379984  8526 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.380750  8526 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.382961  8526 ts_tablet_manager.cc:1434] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:15:30.390339  8579 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.388686  8525 raft_consensus.cc:359] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:30.391669  8525 raft_consensus.cc:385] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.391949  8525 raft_consensus.cc:740] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.389808  8527 raft_consensus.cc:359] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.395838  8527 raft_consensus.cc:385] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.396163  8527 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.407101  8579 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:30.408632  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:30.385295  8890 consensus_queue.cc:1048] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:15:30.417639  8891 consensus_queue.cc:1048] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:15:30.420346  8526 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:30.406387  8527 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.428331  8155 catalog_manager.cc:5697] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.430255  8151 catalog_manager.cc:5697] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.441365  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:30.442070  8480 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.438969  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:30.444247  8477 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.451792  8480 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:30.452052  8220 leader_election.cc:343] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.506002  8525 consensus_queue.cc:260] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:30.516729  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 59890.5us
I20260709 12:15:30.518427  8477 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:30.521034  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 69642.1us
W20260709 12:15:30.525229  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 85945.1us
I20260709 12:15:30.528581  8221 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:30.529881  8779 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.530488  8779 raft_consensus.cc:697] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:30.531596  8525 ts_tablet_manager.cc:1434] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.228s	user 0.010s	sys 0.001s
I20260709 12:15:30.532696  8525 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:30.535530  8779 consensus_queue.cc:237] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.537895  8527 ts_tablet_manager.cc:1434] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.171s	user 0.004s	sys 0.003s
I20260709 12:15:30.539252  8527 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:30.530015  8221 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.548892  8579 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:30.552470  8579 raft_consensus.cc:697] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:30.553435  8579 consensus_queue.cc:237] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.555954  8526 tablet_bootstrap.cc:654] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.582715  8528 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:30.583734  8528 ts_tablet_manager.cc:1403] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.375s	user 0.013s	sys 0.018s
I20260709 12:15:30.587764  8528 raft_consensus.cc:359] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.590277  8525 tablet_bootstrap.cc:654] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.606309  8528 raft_consensus.cc:385] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.609294  8528 raft_consensus.cc:740] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.597738  8527 tablet_bootstrap.cc:654] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.622311  8890 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.622932  8890 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.646610  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:30.647982  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:30.648494  8222 leader_election.cc:343] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.646857  8890 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:30.654155  8153 catalog_manager.cc:5697] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:30.655726  8222 consensus_peers.cc:597] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:30.665446  8892 consensus_queue.cc:1048] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:30.687601  8528 consensus_queue.cc:260] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.691243  8528 ts_tablet_manager.cc:1434] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.001s
I20260709 12:15:30.692940  8528 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:30.697381  8526 tablet_bootstrap.cc:492] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:30.698535  8526 ts_tablet_manager.cc:1403] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.292s	user 0.027s	sys 0.015s
I20260709 12:15:30.700047  8528 tablet_bootstrap.cc:654] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.715056  8894 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:15:30.709611  8478 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:30.716745  8642 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:15:30.731973  8526 raft_consensus.cc:359] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.733786  8526 raft_consensus.cc:385] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.734220  8526 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.743445  8527 tablet_bootstrap.cc:492] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:30.744061  8527 ts_tablet_manager.cc:1403] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.205s	user 0.012s	sys 0.015s
I20260709 12:15:30.762337  8779 consensus_queue.cc:1048] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:30.735952  8526 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:30.770277  8445 consensus_peers.cc:597] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:30.775269  8221 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.782810  8779 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.796802  8526 ts_tablet_manager.cc:1434] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.098s	user 0.011s	sys 0.004s
I20260709 12:15:30.798605  8525 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:30.799216  8525 ts_tablet_manager.cc:1403] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.267s	user 0.015s	sys 0.024s
I20260709 12:15:30.797933  8779 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.817706  8526 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:30.822757  8528 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:30.823352  8528 ts_tablet_manager.cc:1403] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.017s
I20260709 12:15:30.819672  8779 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.819852  8814 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.830873  8527 raft_consensus.cc:359] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.833717  8527 raft_consensus.cc:385] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.834082  8527 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.832775  8894 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.842350  8894 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.843592  8527 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.844938  8894 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:30.845974  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:30.846721  8478 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:30.848212  8525 raft_consensus.cc:359] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.848821  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:30.849095  8525 raft_consensus.cc:385] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.849642  8525 raft_consensus.cc:740] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.849978  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:30.850669  8402 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:30.850458  8525 consensus_queue.cc:260] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.851882  8877 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:30.852414  8877 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.852859  8877 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.853073  8525 ts_tablet_manager.cc:1434] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.003s
I20260709 12:15:30.854292  8525 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:30.833051  8814 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:30.857872  8814 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:30.860795  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:30.861334  8528 raft_consensus.cc:359] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:30.862142  8528 raft_consensus.cc:385] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:30.862429  8528 raft_consensus.cc:740] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:30.866974  8918 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.867619  8918 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.869738  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:30.872728  8918 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:30.848212  8527 ts_tablet_manager.cc:1434] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 12:15:30.874089  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:30.876569  8528 consensus_queue.cc:260] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:30.877406  8222 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.878364  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:30.879249  8478 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:30.879575  8527 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:30.876310  8153 catalog_manager.cc:5697] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.880693  8153 catalog_manager.cc:5697] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:30.886400  8528 ts_tablet_manager.cc:1434] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
W20260709 12:15:30.887185  8220 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.887676  8220 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:30.888579  8814 raft_consensus.cc:2749] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:30.904986  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:30.865913  8779 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:30.923184  8779 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:30.926925  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:30.928232  8528 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:30.927970  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:30.932884  8222 leader_election.cc:343] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:30.925730  8370 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:30.935173  8918 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.927994  8478 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:30.953835  8478 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:30.955958  8527 tablet_bootstrap.cc:654] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.974196  8528 tablet_bootstrap.cc:654] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:30.925299  8877 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:30.993268  8526 tablet_bootstrap.cc:654] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.005038  8918 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:31.008214  8527 tablet_bootstrap.cc:492] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:31.009038  8527 ts_tablet_manager.cc:1403] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.010s
I20260709 12:15:31.016472  8877 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:31.018471  8525 tablet_bootstrap.cc:654] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:31.060287  8892 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.061169  8892 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:31.615904  8892 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:31.632635  8526 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.008s	sys 0.030s
W20260709 12:15:31.715776  8525 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.097s	sys 0.203s
W20260709 12:15:31.799460  8525 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.102s	sys 0.211s
W20260709 12:15:31.799907  8526 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.028s	sys 0.067s
I20260709 12:15:31.811793  8528 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:31.812541  8528 ts_tablet_manager.cc:1403] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.885s	user 0.013s	sys 0.006s
I20260709 12:15:31.860486  8526 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:31.861159  8526 ts_tablet_manager.cc:1403] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 1.044s	user 0.038s	sys 0.069s
I20260709 12:15:31.862922  8525 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:31.863543  8525 ts_tablet_manager.cc:1403] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 1.010s	user 0.113s	sys 0.213s
I20260709 12:15:31.864091  8526 raft_consensus.cc:359] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:31.864992  8526 raft_consensus.cc:385] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.866212  8526 raft_consensus.cc:740] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.866972  8526 consensus_queue.cc:260] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:31.860430  8528 raft_consensus.cc:359] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:31.870332  8528 raft_consensus.cc:385] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.870730  8528 raft_consensus.cc:740] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.871742  8528 consensus_queue.cc:260] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:31.866590  8525 raft_consensus.cc:359] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:31.873602  8525 raft_consensus.cc:385] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:31.874060  8525 raft_consensus.cc:740] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:31.875154  8525 consensus_queue.cc:260] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:31.878337  8528 ts_tablet_manager.cc:1434] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:15:31.880115  8528 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:31.900270  8942 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.906206  8942 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:31.908640  8942 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.002686  8525 ts_tablet_manager.cc:1434] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.139s	user 0.012s	sys 0.001s
I20260709 12:15:32.021113  8528 tablet_bootstrap.cc:700] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Time spent opening tablet: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:15:32.022140  8525 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:32.004160  8946 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.026464  8528 tablet_bootstrap.cc:654] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.036247  8942 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.093798  8526 ts_tablet_manager.cc:1434] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.232s	user 0.053s	sys 0.085s
I20260709 12:15:32.100340  8943 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.101116  8943 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.097071  8892 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.107548  8892 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.110250  8892 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.082602  8800 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.116816  8526 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:32.106674  8943 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.094695  8944 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:32.025949  8946 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.110970  8892 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.126587  8800 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.097959  8942 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.351622  8944 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.354823  8944 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.178687  8946 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.525161  8952 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.526022  8952 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.490097  8946 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:32.529862  8946 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.235545  8942 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.240165  8800 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.367249  8943 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:32.616997  8223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.004s	sys 0.027s
I20260709 12:15:32.490412  8944 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.182945  8892 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:32.625873  8223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.028s
I20260709 12:15:32.634980  8528 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:32.635818  8528 ts_tablet_manager.cc:1403] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.756s	user 0.020s	sys 0.004s
I20260709 12:15:32.636577  8947 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.637143  8947 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.639199  8947 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:32.639305  8946 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.639725  8947 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.632453  8944 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.640247  8947 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.627233  8800 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.642086  8947 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.642168  8950 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.642620  8800 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.645604  8800 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.624585  8943 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.649112  8943 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.650090  8526 tablet_bootstrap.cc:654] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.654675  8525 tablet_bootstrap.cc:654] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.642911  8950 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.661042  8954 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.661635  8954 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.663671  8528 raft_consensus.cc:359] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.664538  8528 raft_consensus.cc:385] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.656977  8892 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.664893  8528 raft_consensus.cc:740] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.642086  8944 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.669591  8528 consensus_queue.cc:260] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.618953  8942 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:32.659902  8446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.019s	sys 0.030s
I20260709 12:15:32.660040  8946 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:32.668179  8954 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.668040  8943 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.683075  8956 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.683821  8956 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.686748  8956 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.687469  8956 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.688064  8956 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:32.675258  8446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.020s	sys 0.030s
I20260709 12:15:32.676723  8950 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:32.677860  8800 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.674306  8942 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.690896  8956 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.679694  8955 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.692309  8892 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.693073  8944 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.708729  8528 ts_tablet_manager.cc:1434] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.001s
I20260709 12:15:32.709615  8954 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.713384  8955 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.678340  8946 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.691454  8943 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.793804  8526 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:32.794312  8955 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.794579  8526 ts_tablet_manager.cc:1403] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.692s	user 0.017s	sys 0.007s
I20260709 12:15:32.795272  8955 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.796002  8955 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.706130  8800 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.744168  8954 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.799613  8526 raft_consensus.cc:359] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.803683  8526 raft_consensus.cc:385] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.771277  8947 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.803962  8526 raft_consensus.cc:740] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.771577  8956 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.809959  8954 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.810527  8954 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:32.787986  8952 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.812067  8943 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.811769  8526 consensus_queue.cc:260] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.814347  8946 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.815613  8526 ts_tablet_manager.cc:1434] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:15:32.787060  8951 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.817013  8526 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:32.816696  8951 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.820288  8942 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.769491  8944 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.721171  8892 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.824398  8956 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.829169  8967 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.831233  8967 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.832970  8800 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.833681  8955 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.824213  8947 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.828222  8964 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.823423  8954 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.834314  8956 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:32.838218  8962 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.836516  8967 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.841169  8961 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.845240  8962 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.845396  8892 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.844251  8964 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.845732  8966 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.846794  8947 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:32.849249  8944 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.848326  8800 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.851769  8957 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.860044  8800 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.860224  8957 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.862212  8957 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.862282  8800 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.854358  8954 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.850139  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.858245  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.865060  8332 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:32.865789  8328 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.848172  8963 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.867188  8963 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.867381  8950 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.848528  8965 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.868997  8965 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.869539  8963 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.859506  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.856765  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.871846  8250 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.855504  8966 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.851994  8964 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.847313  8955 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.846115  8961 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.874524  8955 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.875373  8966 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.857411  8526 tablet_bootstrap.cc:654] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:32.876128  8961 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.873057  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.867439  8957 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.876914  8250 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.877219  8957 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.878125  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.852679  8962 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.873368  8965 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.880504  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.881182  8326 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.881336  8525 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:32.855393  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.881994  8525 ts_tablet_manager.cc:1403] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.860s	user 0.014s	sys 0.011s
I20260709 12:15:32.883055  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.884066  8967 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.884274  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.884626  8967 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.886971  8967 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.887421  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.888705  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.881363  8153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37602 (request call id 73) took 2050 ms. Trace:
I20260709 12:15:32.889891  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.879594  8957 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:32.881202  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.891253  8525 raft_consensus.cc:359] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.892392  8250 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.893530  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.894230  8250 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.895191  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.892568  8525 raft_consensus.cc:385] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.898154  8525 raft_consensus.cc:740] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.891265  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.901772  8252 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:32.896416  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.907406  8326 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.908409  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.909101  8962 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.909825  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.909632  8962 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.910223  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.902089  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.903501  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.911550  8328 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.912142  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.912569  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.912829  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.913296  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.913985  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.914476  8962 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.924461  8962 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.925096  8962 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.927501  8962 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.906608  8967 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.928632  8967 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.929615  8527 raft_consensus.cc:359] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.930539  8527 raft_consensus.cc:385] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.931188  8332 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:32.930667  8967 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:32.935163  8526 tablet_bootstrap.cc:492] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:32.935832  8526 ts_tablet_manager.cc:1403] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.016s
I20260709 12:15:32.938899  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:32.939796  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.915305  8956 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:32.916272  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.940272  8446 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:32.940662  8956 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:32.912613  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.920727  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.944355  8956 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.945194  8960 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.945118  8248 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.922549  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.945870  8960 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:32.946653  8255 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:32.868263  8950 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.905730  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.939999  8963 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:32.899139  8525 consensus_queue.cc:260] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.941234  8800 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:32.917657  8443 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:32.930943  8527 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.941239  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:32.944257  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:32.923684  8955 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:32.959684  8525 ts_tablet_manager.cc:1434] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.002s
I20260709 12:15:32.914862  8325 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:32.952911  8800 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.953545  8324 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.954176  8954 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:32.955607  8869 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:32.956126  8443 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:32.956918  8250 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:32.979153  8978 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.889799  8153 rpcz_store.cc:276] 0709 12:15:30.835445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.835612 (+   167us) service_pool.cc:224] Handling call
0709 12:15:32.881262 (+2045650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:30.883941 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:30.884446 (+   505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:30.884479 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:15:30.884500 (+    21us) tablet.cc:662] Decoding operations
0709 12:15:30.884931 (+   431us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:30.884990 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:30.885015 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:15:30.885340 (+   325us) tablet.cc:701] Row locks acquired
0709 12:15:30.885357 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:15:30.885495 (+   138us) write_op.cc:270] Start()
0709 12:15:30.885609 (+   114us) write_op.cc:276] Timestamp: P: 1783599330885448 usec, L: 0
0709 12:15:30.885633 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:15:30.886258 (+   625us) log.cc:844] Serialized 922 byte log entry
0709 12:15:30.899360 (+ 13102us) op_driver.cc:464] REPLICATION: finished
0709 12:15:30.900066 (+   706us) write_op.cc:301] APPLY: starting
0709 12:15:30.900152 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:30.900293 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:30.900411 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:30.900734 (+   323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:30.900899 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:15:30.900946 (+    47us) write_op.cc:312] APPLY: finished
0709 12:15:30.901157 (+   211us) log.cc:844] Serialized 28 byte log entry
0709 12:15:30.901315 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:30.901409 (+    94us) write_op.cc:454] Released schema lock
0709 12:15:30.901455 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:30.901786 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:30.901817 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":483,"apply.run_cpu_time_us":1711,"apply.run_wall_time_us":1710,"num_ops":2,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2617,"prepare.run_wall_time_us":2618,"replication_time_us":13572}]]}
I20260709 12:15:32.938916  8526 raft_consensus.cc:359] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.979971  8526 raft_consensus.cc:385] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:32.979782  8978 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:32.980422  8526 raft_consensus.cc:740] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:32.982066  8978 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:32.981493  8526 consensus_queue.cc:260] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:32.986833  8443 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:32.988119  8443 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:32.990973  8443 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:33.004858  8443 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.003263  8955 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.006808  8443 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:33.009578  8525 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:32.961059  8963 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:32.948228  8918 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:32.984030  8800 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.978232  8954 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.018739  8526 ts_tablet_manager.cc:1434] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.001s
I20260709 12:15:33.004941  8869 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.010713  8942 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.020152  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.020514  8976 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:32.991544  8944 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.005084  8965 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.013288  8943 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.013708  8946 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.012254  8955 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.014842  8963 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:32.983742  8446 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.027339  8954 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.017475  8978 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.027894  8960 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.021589  8918 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.042456  8955 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.043632  8526 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:33.034495  8944 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.037122  8965 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.048846  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.058790  8403 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:33.059023  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.051450  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.052011  8979 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.047420  8978 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.060577  8979 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.061972  8978 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.062568  8978 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.035511  8250 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.040480  8946 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.063167  8978 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.063915  8946 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.065522  8978 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.059197  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.039662  8943 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.066833  8869 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.054095  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:33.069187  8965 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.075122  8943 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.075950  8979 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.057569  8944 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.102662  8963 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.116837  8963 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:33.042902  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 81267.3us
I20260709 12:15:33.034917  8976 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.577991  8446 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.579372  8976 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.034121  8942 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.580907  8963 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.581456  8963 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.581915  8963 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.582517  8942 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.583132  8399 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.087831  8974 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.584468  8974 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.586051  8993 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:33.090428  8956 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.090704  8962 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.104784  8975 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.091254  8966 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:33.068809  8960 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.124342  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.125746  8954 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.126397  8951 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.142751  8979 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.147516  8983 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.147771  8221 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.143239  8977 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.149482  8980 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.157630  8969 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:33.163301  8943 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.165576  8978 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.166170  8982 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:33.168123  8981 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.169976  8984 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.147825  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.165328  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.705569  8152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37604 (request call id 93) took 2782 ms. Trace:
I20260709 12:15:33.705957  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.706048  8152 rpcz_store.cc:276] 0709 12:15:30.923124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.923409 (+   285us) service_pool.cc:224] Handling call
0709 12:15:33.705478 (+2782069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2615007,"reported_tablets":1}
I20260709 12:15:33.338238  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.708089  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.708485  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.709465  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.710101  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.150695  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.128578  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.094400  8402 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.156286  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.726177  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.140326  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.730405  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.140791  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.355523  8965 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.732578  8480 raft_consensus.cc:1240] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.733425  8965 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.077916  8525 tablet_bootstrap.cc:654] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.738219  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.046301  8892 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.741814  8892 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.741511  8976 consensus_queue.cc:1059] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:33.742229  8892 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.742707  8994 raft_consensus.cc:3055] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:33.743090  8994 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:33.743856  8994 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.744837  8994 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.106817  8918 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.142135  8946 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.364943  8955 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.370667  8944 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.751631  8946 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.753124  8525 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:33.753260  8944 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.753635  8525 ts_tablet_manager.cc:1403] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.748s	user 0.013s	sys 0.000s
I20260709 12:15:33.372061  8987 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.751652  8955 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.446969  8967 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.754185  8987 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.754822  8151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37634 (request call id 75) took 2883 ms. Trace:
I20260709 12:15:33.754688  8967 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.467733  8950 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.756896  8525 raft_consensus.cc:359] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.497398  8961 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.757685  8525 raft_consensus.cc:385] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:33.499469  8957 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.502298  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.758180  8525 raft_consensus.cc:740] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:33.758154  8961 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.759491  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.511744  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.512580  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.760607  8961 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.760902  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.761031  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.761677  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.761989  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.512661  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.514056  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.514289  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.524972  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.526762  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.527298  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.766603  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.766765  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.767860  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.768103  8298 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.768687  8329 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:33.526612  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.529167  8332 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.537634  8991 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.538460  8973 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.770475  8973 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.545864  8443 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:33.771566  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 225773us
I20260709 12:15:33.772750  8973 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.535238  8990 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.563215  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.541910  8992 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.633250  8962 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.775249  8955 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.775835  8955 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.775533  8992 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.776233  8955 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.777089  8962 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.635111  8975 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.777876  8992 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.634300  8960 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:33.778560  8443 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.751s (SENT)
I20260709 12:15:33.779183  8975 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.635924  8980 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.779876  8960 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.775310  8990 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.781219  8980 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.638155  8943 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.638589  8982 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.781929  8404 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.783113  8990 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.783557  8982 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.639578  8984 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.758430  8957 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.784168  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.785477  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.785699  8984 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:33.641136  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 493454us
I20260709 12:15:33.785983  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.787529  8955 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.641855  8966 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.642973  8964 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:33.791214  8403 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.643394  8977 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.642716  8978 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.642534  8981 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.643319  8979 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:33.647163  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 78774.5us
I20260709 12:15:33.640383  8983 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.791263  8955 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.796669  8983 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.653661  8399 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.792130  8251 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:33.654232  8951 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.800362  8327 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.586692  8993 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.800835  8951 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.775431  8400 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:33.803354  8993 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.659142  8963 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.664216  8888 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:33.804349  8888 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.806030  8963 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.806542  8888 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.668327  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.807231  8477 raft_consensus.cc:1240] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.808001  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.808687  8479 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.809635  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.809695  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.669173  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.811312  8476 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.812108  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.648787  8446 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.671173  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.814292  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:33.815069  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 47031.3us
I20260709 12:15:33.815342  8477 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.815794  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.816892  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.671550  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.791630  8964 raft_consensus.cc:697] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:33.818385  8964 consensus_queue.cc:237] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.677716  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.684890  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.683562  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.821146  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.701810  8527 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.822691  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.823097  8398 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:33.824141  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:33.824445  8527 ts_tablet_manager.cc:1434] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 2.815s	user 0.015s	sys 0.000s
I20260709 12:15:33.685458  8528 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:33.711458  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.712946  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.714112  8526 tablet_bootstrap.cc:654] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.800462  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.803961  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:33.717900  8800 consensus_meta.cc:287] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.689s	user 0.019s	sys 0.000s
I20260709 12:15:33.718568  8297 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:33.829597  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 111113us
I20260709 12:15:33.713900  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.726794  8155 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37620 (request call id 71) took 2805 ms. Trace:
I20260709 12:15:33.795002  8981 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.828735  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.833777  8370 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:33.833900  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.826620  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.834638  8330 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:33.739826  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.825942  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.835592  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.835927  8975 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.826293  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.836417  8975 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:33.756629  8987 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.837306  8987 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.832556  8155 rpcz_store.cc:276] 0709 12:15:30.921333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.922111 (+   778us) service_pool.cc:224] Handling call
0709 12:15:33.726707 (+2804596us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2638472,"reported_tablets":1}
I20260709 12:15:33.837935  8987 consensus_queue.cc:1059] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:33.839030  8987 raft_consensus.cc:3055] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:33.792834  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:33.839366  8987 raft_consensus.cc:740] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:33.840047  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.840577  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.527402  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.764385  8525 consensus_queue.cc:260] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.769797  8998 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.841466  8326 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:33.770437  8991 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.766705  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.786099  8404 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:33.586678  8974 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.643731  8956 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:33.843339  8525 ts_tablet_manager.cc:1434] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:15:33.843583  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.844246  8991 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.844465  8525 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
I20260709 12:15:33.651722  8954 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.845021  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.842970  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.845702  8404 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.845029  8956 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.791944  8405 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.847823  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.848187  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.846613  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.848500  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.848802  8405 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.827280  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.849655  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.849848  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.850487  8328 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.825109  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.802913  8951 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:33.669440  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.851442  8398 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.851821  8475 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.852378  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.852844  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.853178  8398 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:33.854025  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.854631  8475 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.826874  8401 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.835747  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.857218  8251 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:33.785702  8957 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.670850  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.795768  8979 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.858074  8473 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.858377  8328 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.794392  8978 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.859048  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.859308  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.859753  8475 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.860066  8473 raft_consensus.cc:2368] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2.
I20260709 12:15:33.860707  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.860918  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.861449  8528 tablet_bootstrap.cc:654] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.861527  8473 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:33.861940  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.863337  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.756923  8967 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.794255  8977 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.864123  8370 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:33.817039  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.864670  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.864912  8472 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.865200  8370 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:33.865453  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.810832  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.866283  8479 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:33.671314  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.867286  8471 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 0.
I20260709 12:15:33.850679  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.868069  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.718492  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.870106  8473 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.833170  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.872717  8250 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
W20260709 12:15:33.831933  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 183217us
I20260709 12:15:33.874485  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.875456  8446 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.875617  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.876464  8954 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:33.372164  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 216457us
W20260709 12:15:33.727861  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:33.824833  8527 ts_tablet_manager.cc:1467] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Tablet startup took 2815ms
I20260709 12:15:33.840711  8399 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.840471  8987 consensus_queue.cc:260] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.561894  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.843178  8406 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.812340  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:33.791338  8966 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.868439  8471 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.892721  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.893069  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.893383  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.818580  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.868851  8472 raft_consensus.cc:1240] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.895576  8478 raft_consensus.cc:2393] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:33.896044  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.896756  8472 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.898039  8472 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.900427  8472 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:33.878082  8527 ts_tablet_manager.cc:1469] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Trace:
0709 12:15:23.451252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.451497 (+   245us) service_pool.cc:224] Handling call
0709 12:15:23.453491 (+  1994us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:23.453588 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:23.573161 (+119573us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:23.603663 (+ 30502us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:23.604138 (+   475us) inbound_call.cc:177] Queueing success response
0709 12:15:30.879122 (+7274984us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:15:31.009456 (+130334us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:15:31.014783 (+  5327us) tablet_replica.cc:261] Starting instrumentation
0709 12:15:31.015553 (+   770us) tablet_replica.cc:280] Starting consensus
0709 12:15:33.701437 (+2685884us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b4c0014fc80. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124c3b9a20 00007f124c3caa29 00007f124c390644 00007f124c3b7f2d 00007f124c3b7b93 00007f124e0e818b 00007f124e0e8cb5 00007f124e0e3f30 00007f124e0e2c40 00007f1251adfb2e 00007f1253101d8a
Metrics: {"mutex_wait_us":1912126,"raft.queue_time_us":6546,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7279,"spinlock_wait_cycles":13705088,"tablet-open.queue_time_us":7274884}
I20260709 12:15:33.878398  8477 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:33.877825  8978 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.903503  8978 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.904004  8978 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.907408  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.909158  8478 raft_consensus.cc:1240] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.909354  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:33.884169  8977 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.902884  8527 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:33.868912  8297 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.869771  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:33.869549  8800 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.893409  8324 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:33.880849  8951 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.918356  8479 raft_consensus.cc:1240] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.918458  8951 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.918965  8951 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.919174  8800 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:33.835708  8480 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:33.877136  8221 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:33.836843  8975 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.916182  8888 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:33.924331  8888 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.924760  8888 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:33.926048  8978 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.927214  8961 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:33.927662  8961 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:33.928011  8961 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.928303  8978 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.929486  8964 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:33.877370  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 98844.8us
I20260709 12:15:33.935956  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.936946  8443 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:33.937460  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:33.937762  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 51386.2us
I20260709 12:15:33.881937  8220 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:33.939026  8964 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.939359  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.939428  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.939026  8446 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:33.940675  8296 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:33.941505  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 59656.3us
W20260709 12:15:33.941829  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 72994.4us
W20260709 12:15:33.942118  8220 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.942356  8296 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:33.942546  8297 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.940827  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.885289  8525 tablet_bootstrap.cc:654] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:33.880398  8222 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:33.885342  8331 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:33.944169  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 122) took 1086 ms. Trace:
W20260709 12:15:33.944108  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 65668.6us
I20260709 12:15:33.887949  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:33.944801  8222 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.945283  8222 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.888235  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.848428  8403 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:33.888959  8476 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.947614  8998 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.948347  8967 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.949482  8800 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.949884  8800 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.950237  8800 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.889523  8987 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.951527  8296 leader_election.cc:400] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2.
I20260709 12:15:33.951843  8296 leader_election.cc:403] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:33.891196  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.877810  8954 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:33.891615  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.955318  8954 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.891849  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:33.749689  8892 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.931221  8974 consensus_queue.cc:1059] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:33.957046  8974 raft_consensus.cc:3055] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:33.957440  8974 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:33.957921  8892 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.958247  8974 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.959334  8474 raft_consensus.cc:1240] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.960036  8975 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:33.961143  8323 raft_consensus.cc:1240] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:33.961500  8986 raft_consensus.cc:2749] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:33.961771  8222 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.964021  8222 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:33.964826  8986 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.965194  8986 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:33.965548  8986 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.967384  8476 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:33.968278  8975 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:33.940930  8369 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:33.959522  8974 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.969512  8977 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.969923  8977 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.970301  8977 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.971261  8967 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.971962  8404 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
W20260709 12:15:33.916278  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 51160.2us
I20260709 12:15:33.972887  8370 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:33.973891  8370 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:33.975936  8296 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:33.976135  8979 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.976792  8979 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.977226  8979 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.874775  8445 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:33.979548  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 104851us
I20260709 12:15:33.980368  8369 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:33.980662  8445 leader_election.cc:343] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.981323  8991 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.981598  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.947314  8956 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.982223  8956 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.982628  8956 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.984108  8954 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:33.985327  8403 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:33.985770  8961 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:33.986434  8954 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:33.943462  8955 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.956035  8966 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:33.976236  8998 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.981704  8991 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:33.988472  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:33.988970  8991 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.990772  8955 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:33.944511  8331 rpcz_store.cc:276] 0709 12:15:32.858137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:33.561404 (+703267us) service_pool.cc:224] Handling call
0709 12:15:33.944109 (+382705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:33.988462  8966 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:33.991955  8966 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.994437  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:33.996910  8967 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2.
I20260709 12:15:33.998342  8401 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:33.982636  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:33.998454  8991 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.001751  8526 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:34.018215  8526 ts_tablet_manager.cc:1403] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.986s	user 0.040s	sys 0.021s
I20260709 12:15:33.987679  8527 tablet_bootstrap.cc:654] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:33.991971  8445 leader_election.cc:343] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.003516  8296 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:34.020207  8445 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.020635  8445 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.018644  8370 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.021327  8955 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.022161  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.021322  8998 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.023948  8993 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.024359  8993 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.024748  8993 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.004335  8954 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:34.027386  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 66302.9us
W20260709 12:15:34.027738  8445 leader_election.cc:343] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:33.976130  8297 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:33.755297  8151 rpcz_store.cc:276] 0709 12:15:30.871580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:30.871747 (+   167us) service_pool.cc:224] Handling call
0709 12:15:33.754754 (+2883007us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2532936,"reported_tablets":6}
I20260709 12:15:34.007259  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.009859  8979 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.010511  8956 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.012493  8986 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.014236  8967 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.014683  8977 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.016081  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.000026  8961 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.033157  8954 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.045133  8986 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:34.045418  8954 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.048657  8977 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.028460  8445 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.029315  8220 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:33.941159  8446 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.003707  8987 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.040314  8800 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.056833  8955 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.062186  8955 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.062769  8955 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.067732  8954 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.017241  8966 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.038969  8967 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.039852  8973 consensus_queue.cc:1059] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:15:34.042754  8400 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.043483  8979 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.043776  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.044091  8956 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.052080  8445 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.054419  8970 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:15:34.039103  8962 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.054472  8986 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:34.101552  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 64348.5us
I20260709 12:15:34.041342  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:34.033952  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 57909.9us
I20260709 12:15:34.077355  8967 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.103879  8372 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.106696  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.107198  8973 consensus_queue.cc:1059] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.102056  8986 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.108165  8986 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.108407  8956 raft_consensus.cc:3055] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.108809  8956 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.109588  8956 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.110934  8956 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.111208  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.112484  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:34.113682  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:34.077777  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 136684us
I20260709 12:15:34.071095  8800 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.127883  8446 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.129585  8943 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.129660  8446 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:34.130640  8943 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.132957  8975 raft_consensus.cc:3055] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.133358  8975 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.134183  8975 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.134847  8955 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.117918  8987 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.139302  8943 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.083300  8892 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.026922  8951 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.139765  8943 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.076889  8528 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:34.140625  8528 ts_tablet_manager.cc:1403] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.455s	user 0.013s	sys 0.008s
W20260709 12:15:34.041503  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 66554.6us
I20260709 12:15:34.086724  8998 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:34.098245  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 46217.3us
I20260709 12:15:34.143639  8445 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.144753  8445 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.103861  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.104333  8963 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.106439  8993 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.079118  8966 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.081717  8526 raft_consensus.cc:359] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.157758  8526 raft_consensus.cc:385] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.158175  8526 raft_consensus.cc:740] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.159085  8526 consensus_queue.cc:260] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.118664  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:34.120177  8297 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.122061  8372 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.122210  8954 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.122817  8298 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:34.099095  8888 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:34.125227  8427 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9300 after lost signal to thread 3214
I20260709 12:15:34.102512  8962 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.095283  8961 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.068847  8991 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:34.142179  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 101620us
I20260709 12:15:34.154156  8944 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.170954  8222 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.162147  8800 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.146198  8445 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.135583  8975 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.165899  8525 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:34.168092  8983 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.172132  8222 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.139858  8892 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.153268  8963 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:34.189903  8222 leader_election.cc:343] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.182924  8525 ts_tablet_manager.cc:1403] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.339s	user 0.012s	sys 0.008s
I20260709 12:15:34.166064  8526 ts_tablet_manager.cc:1434] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.147s	user 0.008s	sys 0.000s
W20260709 12:15:34.180462  8427 debug-util.cc:398] Leaking SignalData structure 0x7b080024ada0 after lost signal to thread 8151
I20260709 12:15:34.169237  8982 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.170970  8962 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.179454  8966 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.179812  8800 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.183506  8955 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.183508  8954 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.198715  8980 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.199215  8526 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:34.193893  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:34.192858  8427 debug-util.cc:398] Leaking SignalData structure 0x7b080024a760 after lost signal to thread 8152
I20260709 12:15:34.204205  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.204375  8445 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.199513  8324 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:15:34.168164  8370 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.207528  8476 raft_consensus.cc:1240] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.207828  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.192909  8963 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.206046  8445 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.191282  8892 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:34.181638  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 59656.8us
I20260709 12:15:34.192473  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:34.212096  8982 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.223228  8945 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.223770  8945 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.179713  8961 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:34.215189  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52194.4us
I20260709 12:15:34.224125  8967 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.225183  8370 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.225848  8961 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.226312  8967 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.226429  8370 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.215417  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.227243  8331 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:34.215759  8954 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.227929  8954 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.228407  8954 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.229959  8328 raft_consensus.cc:1240] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.231305  8982 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.231732  8982 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.232106  8982 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.233623  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:34.213584  8445 leader_election.cc:343] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.234612  8526 tablet_bootstrap.cc:654] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.209616  8980 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.234965  8445 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:34.235472  8980 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.237295  8950 consensus_queue.cc:1059] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.238371  8950 raft_consensus.cc:3055] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.217232  8372 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.239656  8951 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.193976  9004 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.240306  8951 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:34.240815  8951 raft_consensus.cc:697] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:34.241043  8221 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.241215  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.210587  8944 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.242375  8944 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.216596  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.242609  8957 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.217276  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.216216  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.200616  8956 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.224152  8945 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.201722  8800 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.217633  8993 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.217612  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.203318  8974 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.200152  8964 consensus_queue.cc:1059] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:15:34.219069  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:34.208966  8427 debug-util.cc:398] Leaking SignalData structure 0x7b080024b220 after lost signal to thread 8153
W20260709 12:15:34.248843  8427 debug-util.cc:398] Leaking SignalData structure 0x7b080024b380 after lost signal to thread 8155
I20260709 12:15:34.248965  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.249301  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:34.249609  8427 debug-util.cc:398] Leaking SignalData structure 0x7b080024afe0 after lost signal to thread 8189
I20260709 12:15:34.249794  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.218406  8986 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.251390  8888 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.252955  8986 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.247265  8974 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.249354  8964 raft_consensus.cc:3055] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.253911  8964 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.254702  8964 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.255211  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:34.242799  8944 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:34.256147  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:34.256219  8943 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.256628  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.256896  8964 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.257408  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.228788  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:34.260571  8527 tablet_bootstrap.cc:492] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:34.261076  8527 ts_tablet_manager.cc:1403] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.358s	user 0.025s	sys 0.034s
I20260709 12:15:34.238703  8950 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.228025  8525 raft_consensus.cc:359] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.263371  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.263790  8525 raft_consensus.cc:385] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.264123  8525 raft_consensus.cc:740] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.263598  8950 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.264775  8525 consensus_queue.cc:260] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.265189  8950 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.265413  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:34.267949  8427 debug-util.cc:398] Leaking SignalData structure 0x7b08003715e0 after lost signal to thread 8281
I20260709 12:15:34.267589  8951 consensus_queue.cc:237] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.194281  8983 raft_consensus.cc:697] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.268395  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:34.269200  8427 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1d00 after lost signal to thread 8356
I20260709 12:15:34.269294  8983 consensus_queue.cc:237] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:34.270537  8427 debug-util.cc:398] Leaking SignalData structure 0x7b0800300700 after lost signal to thread 8430
I20260709 12:15:34.215605  8528 raft_consensus.cc:359] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.271275  8528 raft_consensus.cc:385] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.271586  8528 raft_consensus.cc:740] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.255040  8974 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.240973  8991 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.276098  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.272210  8528 consensus_queue.cc:260] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.300793  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.301295  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:34.299469  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 176721us
W20260709 12:15:34.295768  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 175700us
I20260709 12:15:34.310130  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.276650  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.312078  8527 raft_consensus.cc:359] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.321151  8527 raft_consensus.cc:385] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:34.319963  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 48972.1us
I20260709 12:15:34.315389  8528 ts_tablet_manager.cc:1434] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.174s	user 0.004s	sys 0.004s
I20260709 12:15:34.297276  8959 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.324306  8527 raft_consensus.cc:740] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.337422  8527 consensus_queue.cc:260] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.311730  8993 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:34.334718  8427 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9ca0 after lost signal to thread 8504
I20260709 12:15:34.341532  8297 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:34.312203  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 46866.5us
I20260709 12:15:34.307850  9004 consensus_queue.cc:1059] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:15:34.322652  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 96312.2us
I20260709 12:15:34.309149  8892 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.375033  9010 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:34.314422  8963 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.376163  8297 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.377113  9016 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:34.362430  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08000977e0 after lost signal to thread 3214
I20260709 12:15:34.378332  9006 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:34.378829  8956 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.354816  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.311892  9014 consensus_queue.cc:1059] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:15:34.323525  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:34.384351  8427 debug-util.cc:398] Leaking SignalData structure 0x7b0800114b20 after lost signal to thread 8873
I20260709 12:15:34.375377  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.385612  8297 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:34.340374  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:34.347910  8993 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:34.390410  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 89732us
I20260709 12:15:34.383075  8527 ts_tablet_manager.cc:1434] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.122s	user 0.012s	sys 0.003s
I20260709 12:15:34.342271  8969 consensus_queue.cc:1059] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:15:34.398111  8331 raft_consensus.cc:1240] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.340622  8957 consensus_queue.cc:1059] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:15:34.357192  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.372287  9009 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.398586  8297 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.386270  9016 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.399884  8221 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.390975  8975 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.405109  8297 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:34.402499  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 80246.5us
I20260709 12:15:34.404758  8983 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.406183  8527 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:34.411263  8474 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:34.413522  9014 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.411307  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.418135  8255 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:34.398886  8993 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.419572  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:34.420517  8472 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:34.420671  8964 consensus_queue.cc:1059] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:34.421801  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:34.394320  8298 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:34.424320  9004 raft_consensus.cc:3055] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.402426  8961 consensus_queue.cc:1059] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:15:34.425630  8961 raft_consensus.cc:3055] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.396306  8948 raft_consensus.cc:3055] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.419317  8969 raft_consensus.cc:3055] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.424765  9004 raft_consensus.cc:740] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.406610  8222 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.426891  8983 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.426527  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.433048  8948 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.402856  8956 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.437260  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:34.441180  8525 ts_tablet_manager.cc:1434] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.250s	user 0.022s	sys 0.017s
I20260709 12:15:34.396457  9006 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:34.454449  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 47892.2us
I20260709 12:15:34.517737  8222 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:34.518952  8222 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.454811  9021 raft_consensus.cc:2749] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.520169  9021 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.435587  8969 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.520846  8527 tablet_bootstrap.cc:654] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.521299  8969 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.456476  8221 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.523672  9018 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:15:34.523808  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 67406.7us
I20260709 12:15:34.525475  9006 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:34.458076  8220 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.526448  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 68400.2us
W20260709 12:15:34.527355  8220 leader_election.cc:343] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.435776  8998 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.464596  8446 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:34.405939  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080039b100 after lost signal to thread 8189
I20260709 12:15:34.465240  8472 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:34.405938  9016 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:34.419572  8943 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.394714  9010 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.475093  8957 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.397183  8370 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.458297  8986 consensus_queue.cc:1059] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.478358  8963 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.474669  8892 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.479457  8528 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:34.480427  8800 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.426005  8961 raft_consensus.cc:740] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.470352  8962 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.504189  8945 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.426494  8980 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:34.526603  8222 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.422664  8944 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.535445  8948 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.536007  8962 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.510286  8982 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.539433  8328 raft_consensus.cc:2393] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:34.539676  8961 consensus_queue.cc:260] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.496060  8954 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.543991  8476 raft_consensus.cc:1240] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.515308  8956 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:34.545440  8956 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.535820  8222 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.552747  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:34.571523  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 162269us
W20260709 12:15:34.572551  8297 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.576432  8297 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.581041  9006 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.506886  8993 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.588466  8443 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:34.588812  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 69180.9us
I20260709 12:15:34.573864  8155 catalog_manager.cc:5697] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 1 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:34.589511  8221 leader_election.cc:343] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.516438  8983 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.593264  8221 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.532559  9009 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.560426  8961 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.551501  8982 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.603891  8525 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Bootstrap starting.
W20260709 12:15:34.638871  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 47855us
I20260709 12:15:34.590826  8473 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.655473  8220 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.597955  8987 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.587908  8323 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.590130  8969 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.627368  8479 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.642766  8892 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.640041  9020 raft_consensus.cc:2749] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:34.644951  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 52014.6us
W20260709 12:15:34.645793  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 56320us
I20260709 12:15:34.601097  9022 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.650254  9018 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.603287  8443 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.586215  8998 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:15:34.606501  8943 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.694406  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.694490  8943 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.696906  8943 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.700055  8248 raft_consensus.cc:1240] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.633797  8948 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.702109  9006 consensus_queue.cc:1059] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.671773  8987 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.684136  8944 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.707397  8397 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.558563  8957 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:34.703397  8950 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.708137  8957 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.708300  8950 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.710589  8950 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:34.707468  8987 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.711858  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.712774  8399 raft_consensus.cc:2393] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:34.713838  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.682368  8800 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:34.715584  8967 raft_consensus.cc:3055] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.716048  8967 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.717041  8967 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.706151  8974 consensus_queue.cc:1059] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:15:34.605378  8980 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.605504  9010 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:34.641362  9009 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:34.640367  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 251665us
W20260709 12:15:34.682499  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 79283.1us
I20260709 12:15:34.660326  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:34.672883  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc160 after lost signal to thread 8281
I20260709 12:15:34.656720  8954 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.660563  8986 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.703260  9006 raft_consensus.cc:3055] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.686082  8993 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:34.683674  8963 raft_consensus.cc:2749] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.688062  8956 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.688948  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.689208  8998 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:34.747253  8998 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.748647  8998 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.690038  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:34.691138  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.692049  8526 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:34.734531  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.680711  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.750417  8998 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:34.775089  8370 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:34.789657  8993 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.790686  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.772871  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.791942  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.792280  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:34.789757  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 46364us
I20260709 12:15:34.793491  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.693397  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.794085  8370 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.794759  8254 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:34.795500  8526 ts_tablet_manager.cc:1403] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.596s	user 0.033s	sys 0.028s
I20260709 12:15:34.786136  8948 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:34.693192  8945 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.673452  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.727504  8443 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.718487  8967 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.707767  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.829706  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.830500  8329 raft_consensus.cc:2393] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:34.761096  8956 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:34.831089  8328 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:34.831523  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.831753  8325 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:34.832094  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.832726  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.833498  8329 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:34.706107  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.746392  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:34.834935  8249 raft_consensus.cc:2393] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:34.771036  8964 raft_consensus.cc:3055] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.835978  8964 raft_consensus.cc:740] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.837347  8964 consensus_queue.cc:260] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:34.776114  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08001bff60 after lost signal to thread 8356
I20260709 12:15:34.774279  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:34.655861  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 191363us
W20260709 12:15:34.838847  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08000e81e0 after lost signal to thread 8357
I20260709 12:15:34.839107  8326 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:34.839373  8446 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.685650  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.840240  8954 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:34.840553  8278 debug-util.cc:398] Leaking SignalData structure 0x7b0800085100 after lost signal to thread 8430
I20260709 12:15:34.840822  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.842008  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.720557  8528 tablet_bootstrap.cc:654] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.845592  8954 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.847896  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.848012  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.848965  8955 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.850208  8446 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:34.737380  9006 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.827890  8979 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:34.827975  8963 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.750838  8330 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:34.851267  8979 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:34.752655  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.851768  8979 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.852887  8402 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.853070  8398 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.854010  8298 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:34.841055  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6400 after lost signal to thread 8431
W20260709 12:15:34.855619  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb4e0 after lost signal to thread 8504
W20260709 12:15:34.855942  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb400 after lost signal to thread 8505
I20260709 12:15:34.847249  8957 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:34.826085  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 98637.3us
W20260709 12:15:34.856302  8278 debug-util.cc:398] Leaking SignalData structure 0x7b08002575c0 after lost signal to thread 8525
I20260709 12:15:34.856456  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:34.857170  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080009ed60 after lost signal to thread 8892
W20260709 12:15:34.857573  8278 debug-util.cc:398] Leaking SignalData structure 0x7b080016f7c0 after lost signal to thread 8918
I20260709 12:15:34.857474  8443 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.859021  8443 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.859212  8963 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.859795  8963 raft_consensus.cc:697] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:34.859994  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:34.860440  8888 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.860702  8963 consensus_queue.cc:237] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.861311  8888 consensus_queue.cc:1059] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:34.861493  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.862555  8800 raft_consensus.cc:3055] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.863005  8800 raft_consensus.cc:740] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:34.863991  8975 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:34.865836  8251 raft_consensus.cc:1240] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:34.866415  8222 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.869195  9004 consensus_queue.cc:260] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.869459  9006 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.870507  9004 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.870738  9006 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.796331  8948 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:34.856287  8403 raft_consensus.cc:1240] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.876366  8406 raft_consensus.cc:1240] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.880210  8369 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.881888  8993 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.883291  8369 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.769670  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.884183  8993 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.863940  8800 consensus_queue.cc:260] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.888216  8800 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.889333  9026 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:34.890792  8975 raft_consensus.cc:3055] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.891223  8975 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.892113  8975 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.894181  9026 consensus_queue.cc:1059] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:34.822827  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:34.895629  9027 raft_consensus.cc:3055] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.895995  9027 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:34.896842  9027 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:34.897842  9027 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.859006  8957 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.905090  8970 consensus_queue.cc:1059] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:34.906751  8970 raft_consensus.cc:3055] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:34.907171  8970 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:34.909152  8970 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:34.910791  8970 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:34.924533  8888 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:34.925299  8888 raft_consensus.cc:697] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:34.926450  8888 consensus_queue.cc:237] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:34.939754  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 258595us
W20260709 12:15:34.783027  8297 leader_election.cc:343] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:34.945437  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 162496us
I20260709 12:15:34.950001  8297 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.951174  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:34.956993  8478 raft_consensus.cc:2393] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:34.950793  8480 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:34.854212  8402 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:34.946344  8443 leader_election.cc:343] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.960457  8297 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.963325  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:34.964963  8443 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.963562  8297 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.966296  8443 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.941972  8975 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:34.966415  8220 leader_election.cc:343] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:34.975363  8443 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.971663  8220 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:34.976083  8526 raft_consensus.cc:359] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.977382  8526 raft_consensus.cc:385] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.977820  8526 raft_consensus.cc:740] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.977625  8443 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:34.973464  8525 tablet_bootstrap.cc:654] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.783442  9016 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:34.943290  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 149353us
I20260709 12:15:34.959463  8956 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:34.942359  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 92304.6us
W20260709 12:15:34.947220  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 93305.4us
I20260709 12:15:34.966073  8948 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.970314  8892 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:34.766340  8983 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.967509  9026 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.015605  8298 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:34.959964  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 76786.3us
I20260709 12:15:35.017378  8967 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.018270  8967 consensus_queue.cc:1059] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:34.990486  8527 tablet_bootstrap.cc:492] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:34.981217  8526 consensus_queue.cc:260] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:34.952013  8957 consensus_queue.cc:1059] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:15:34.972153  8954 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:34.969901  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:34.970111  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:34.988018  8255 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:34.972750  9025 consensus_queue.cc:1048] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:15:35.004349  8257 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:35.010462  9016 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:34.989851  8951 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:34.985860  8943 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:34.974745  8980 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.015072  8406 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.030893  8331 raft_consensus.cc:1240] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.059306  8527 ts_tablet_manager.cc:1403] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.655s	user 0.029s	sys 0.004s
I20260709 12:15:35.019843  8445 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:34.970489  8973 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:15:35.061311  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:35.010054  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.064630  8943 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:34.970145  9018 consensus_queue.cc:1059] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:34.972903  9010 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 12:15:35.066332  8222 consensus_peers.cc:597] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:35.076146  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 56385.2us
I20260709 12:15:34.995752  8986 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.032236  8964 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.024848  8983 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:34.992355  9014 consensus_queue.cc:1059] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:15:35.068740  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:35.110924  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 44815.2us
I20260709 12:15:35.067638  8951 raft_consensus.cc:697] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.119385  8528 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:35.113503  8445 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:35.122498  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 141694us
I20260709 12:15:35.079909  8944 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:35.113160  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.027984  8969 consensus_queue.cc:1059] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:15:35.109346  8406 raft_consensus.cc:1275] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:35.033756  8987 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.119971  8526 ts_tablet_manager.cc:1434] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.324s	user 0.010s	sys 0.003s
I20260709 12:15:35.123418  8528 ts_tablet_manager.cc:1403] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.644s	user 0.022s	sys 0.010s
I20260709 12:15:35.021018  8979 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.122061  8474 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.067863  8950 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
W20260709 12:15:35.123503  8443 leader_election.cc:343] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.109727  8943 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.128559  8327 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:35.130443  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:35.143302  8398 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.138695  8527 raft_consensus.cc:359] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.145097  8527 raft_consensus.cc:385] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.145432  8527 raft_consensus.cc:740] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
W20260709 12:15:35.126339  8445 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.065362  8954 raft_consensus.cc:697] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.147861  8954 consensus_queue.cc:237] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.149125  9009 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.152040  8951 consensus_queue.cc:237] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.071086  8370 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:35.153755  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 97771us
I20260709 12:15:35.154559  8370 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.155248  8332 raft_consensus.cc:1240] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.155376  8982 raft_consensus.cc:2764] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:35.156220  8982 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:35.120605  8961 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:35.123564  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:35.131551  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.137295  8330 raft_consensus.cc:1240] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.144385  8987 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.109190  8323 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:35.127604  9020 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.187177  8405 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.159708  8526 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:35.155316  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.158427  8527 consensus_queue.cc:260] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.168102  8954 consensus_queue.cc:1048] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:35.181136  8404 raft_consensus.cc:1240] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.146768  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:35.196668  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 61330.8us
I20260709 12:15:35.183921  8982 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:35.130932  8298 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.213184  8479 raft_consensus.cc:1240] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.213285  8249 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.215699  9009 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:35.216826  8406 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.218629  8967 raft_consensus.cc:3055] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.219096  8967 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:35.219295  8443 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:35.221553  8954 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:35.221428  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:35.222131  8954 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.223299  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:35.223060  8954 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.225230  8443 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:35.226944  8800 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:35.227662  8800 raft_consensus.cc:697] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.228842  8800 consensus_queue.cc:237] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.229593  8471 raft_consensus.cc:1240] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:35.223536  9035 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:15:35.247530  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 92294.3us
I20260709 12:15:35.290779  8221 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.260499  8957 consensus_queue.cc:1059] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:35.210269  8982 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.293706  8962 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:35.220034  8967 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.267313  9014 consensus_queue.cc:1059] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:35.268251  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.272720  8473 raft_consensus.cc:1240] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.273743  8986 raft_consensus.cc:2749] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.275756  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.306082  8249 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:35.276531  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.276943  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.277208  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:35.278676  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.281605  8945 consensus_queue.cc:1059] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:35.283309  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.414943  8962 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:35.415621  8472 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:35.415733  8962 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.418174  8962 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:35.284003  8973 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:35.234943  8943 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.418540  9010 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:35.418915  8973 raft_consensus.cc:697] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:35.419118  9010 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.420367  8943 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:35.420045  8973 consensus_queue.cc:237] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.324193  8970 consensus_queue.cc:1059] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:15:35.421260  9010 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.422734  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:35.424733  9027 consensus_meta.cc:287] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.007s
I20260709 12:15:35.323648  8979 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:35.283456  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 156573us
I20260709 12:15:35.433732  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:35.286445  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.287549  9031 raft_consensus.cc:3055] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.288214  8948 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:35.214555  8528 raft_consensus.cc:359] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.298311  8370 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.303340  8951 consensus_queue.cc:1059] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.309566  9004 consensus_queue.cc:1059] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:15:35.413991  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.307024  8975 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:35.417906  8982 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.424572  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:35.157300  8950 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.188326  8961 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.430853  8526 tablet_bootstrap.cc:654] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.437938  8332 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:35.439237  8445 consensus_peers.cc:597] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.444555  8255 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:35.497982  8405 raft_consensus.cc:1240] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.306869  9019 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.455245  8527 ts_tablet_manager.cc:1434] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.380s	user 0.014s	sys 0.004s
I20260709 12:15:35.466182  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:35.457688  8966 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:35.467046  8962 consensus_queue.cc:1059] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.306824  9009 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 12:15:35.457448  8963 raft_consensus.cc:3055] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.442375  9031 raft_consensus.cc:740] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.432581  8253 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:35.485355  9046 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.483629  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.484153  8943 raft_consensus.cc:3055] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.481464  8950 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.488652  8961 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.443272  8326 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:35.517612  9021 consensus_queue.cc:1059] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:15:35.488328  8948 consensus_queue.cc:1059] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.524437  9046 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.525321  8948 raft_consensus.cc:3055] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.525614  8527 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:35.525691  8948 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.527056  9046 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.526827  8948 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:35.495831  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 56741.6us
I20260709 12:15:35.445369  8528 raft_consensus.cc:385] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.529170  8528 raft_consensus.cc:740] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.534811  8528 consensus_queue.cc:260] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:35.499833  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 292763us
I20260709 12:15:35.472462  8975 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:35.528524  8445 leader_election.cc:343] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.500520  8525 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: No bootstrap required, opened a new log
I20260709 12:15:35.447881  8956 raft_consensus.cc:3055] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.514057  8963 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.549973  8332 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
W20260709 12:15:35.504431  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:35.472844  8979 raft_consensus.cc:2749] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.470280  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.489907  8252 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.498054  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.542887  8525 ts_tablet_manager.cc:1403] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent bootstrapping tablet: real 0.953s	user 0.079s	sys 0.082s
I20260709 12:15:35.523548  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:35.517696  8400 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:35.523285  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:35.521899  8943 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:35.527560  8982 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.575726  8943 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.577342  8963 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.551420  8443 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.580407  8951 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.580922  8951 raft_consensus.cc:697] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:35.580987  9048 log.cc:927] Time spent T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:15:35.581876  8951 consensus_queue.cc:237] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.547564  8446 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.544833  8956 raft_consensus.cc:740] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:35.543982  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:35.623803  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 90202.6us
I20260709 12:15:35.624760  8446 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.625887  8955 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.626674  8955 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.628190  8446 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.554410  8528 ts_tablet_manager.cc:1434] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.423s	user 0.008s	sys 0.000s
I20260709 12:15:35.548988  8986 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.574271  8330 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.574460  8987 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:35.590161  8975 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:35.592542  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:35.634690  8331 raft_consensus.cc:2393] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.592921  8298 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.593149  8962 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.557272  8948 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.513661  8966 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.638814  8252 raft_consensus.cc:1275] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:35.639395  8250 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:35.640895  8966 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:35.593850  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:35.573539  8248 raft_consensus.cc:1240] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.594442  8296 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.643131  8974 raft_consensus.cc:3055] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.595206  8982 consensus_queue.cc:1059] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:35.643595  8974 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.644313  9009 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.644691  8982 raft_consensus.cc:3055] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.623806  8956 consensus_queue.cc:260] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.595799  8472 raft_consensus.cc:2393] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.645242  8962 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.645977  8956 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.643389  8975 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.647787  8962 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:35.596324  8963 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.597393  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:35.643184  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 48817.2us
I20260709 12:15:35.651623  8480 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.652891  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.653228  8296 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.598788  8476 raft_consensus.cc:1240] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.599434  8254 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:35.599637  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.601471  8297 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:35.658377  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 57002.2us
I20260709 12:15:35.603248  8998 raft_consensus.cc:3055] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.661094  8998 raft_consensus.cc:740] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
W20260709 12:15:35.606844  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.611443  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:35.657508  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:35.663596  8474 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.597337  8251 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:35.636714  8987 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.617662  8325 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:35.618363  9022 raft_consensus.cc:3055] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.664829  9022 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.657789  8967 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.665720  9022 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.666198  8987 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:35.667059  9022 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.670286  8475 raft_consensus.cc:2393] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.618669  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:35.671159  9009 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:35.671614  9009 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:35.671695  8475 raft_consensus.cc:1240] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.672062  9009 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.554458  8221 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.632018  8986 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.635373  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.633589  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:35.643519  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 50706us
I20260709 12:15:35.646533  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.699442  8298 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.700075  8472 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.700294  8986 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:35.598409  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.700837  8961 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.701274  8961 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.701614  8961 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.705391  8527 tablet_bootstrap.cc:654] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.705546  8479 raft_consensus.cc:2393] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.571208  9031 consensus_queue.cc:260] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.655704  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.706672  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:35.661248  8331 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:35.678269  8955 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:35.707612  8955 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.709041  8370 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.709798  8955 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:35.678751  8945 consensus_queue.cc:1048] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:35.682209  8888 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:35.713485  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:35.714393  8331 raft_consensus.cc:2393] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:35.662427  8998 consensus_queue.cc:260] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.658087  8962 raft_consensus.cc:2749] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.715277  8998 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:35.683502  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 55443.9us
I20260709 12:15:35.687422  8969 raft_consensus.cc:3055] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.716025  8969 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.716944  8969 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.644834  8974 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.682718  8323 raft_consensus.cc:1275] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:35.688156  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:35.689716  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.690709  9018 raft_consensus.cc:3055] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:35.692548  8526 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:35.693531  8528 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c: Bootstrap starting.
I20260709 12:15:35.610615  8525 raft_consensus.cc:359] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.718276  8969 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:35.695924  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 142785us
I20260709 12:15:35.698873  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:35.706928  8480 raft_consensus.cc:2393] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.633292  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:35.707027  9031 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.709944  8993 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.714140  8888 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:35.740801  8253 raft_consensus.cc:2393] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:35.740944  8973 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.741812  8479 raft_consensus.cc:1240] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.645344  8982 raft_consensus.cc:740] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:35.732678  9014 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.743331  8256 raft_consensus.cc:2393] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:35.728048  8297 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:35.695478  8332 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:35.736084  8526 ts_tablet_manager.cc:1403] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.600s	user 0.013s	sys 0.010s
I20260709 12:15:35.736032  8525 raft_consensus.cc:385] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.740321  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:35.746532  8331 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:35.710839  8370 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:35.731389  8369 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:35.741497  8973 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:35.750629  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.760070  8369 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:35.760601  8478 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.751314  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:35.746147  8525 raft_consensus.cc:740] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.768329  8221 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.735682  9018 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:35.774194  9060 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.778219  8525 consensus_queue.cc:260] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.780748  8525 ts_tablet_manager.cc:1434] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent starting tablet: real 0.225s	user 0.011s	sys 0.001s
I20260709 12:15:35.783159  8471 raft_consensus.cc:2393] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:35.766582  8993 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:35.762358  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:35.734957  9009 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.796793  8993 raft_consensus.cc:697] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:35.772657  9025 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:35.797894  8993 consensus_queue.cc:237] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.798537  9018 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:35.799213  8248 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:35.799945  9018 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:35.800351  8526 raft_consensus.cc:359] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.801324  8526 raft_consensus.cc:385] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.801681  8526 raft_consensus.cc:740] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.801903  8961 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.771826  8982 consensus_queue.cc:260] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:35.774426  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 147) took 1099 ms. Trace:
I20260709 12:15:35.805770  8298 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:35.802563  8526 consensus_queue.cc:260] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:35.774863  8981 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:35.816687  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 52455.2us
I20260709 12:15:35.807722  8397 rpcz_store.cc:276] 0709 12:15:34.703619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.703799 (+   180us) service_pool.cc:224] Handling call
0709 12:15:34.707205 (+  3406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:34.758616 (+ 51411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:34.758649 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:34.764009 (+  5360us) log.cc:844] Serialized 26 byte log entry
0709 12:15:34.960486 (+196477us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:35.144433 (+183947us) log.cc:844] Serialized 14 byte log entry
0709 12:15:35.712291 (+567858us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b180013c060. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287 00007f124e108208
0709 12:15:35.773913 (+ 61622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:35.774017 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:35.774071 (+    54us) raft_consensus.cc:1685] finished
0709 12:15:35.774173 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:35.774341 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":219851,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":61,"raft.queue_time_us":24504,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":3959,"spinlock_wait_cycles":12614400,"thread_start_us":369229,"threads_started":3,"wal-append.queue_time_us":306956}
I20260709 12:15:35.814158  9025 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:35.829103  8526 ts_tablet_manager.cc:1434] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.002s
I20260709 12:15:35.822660  8369 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:35.811852  8962 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:35.834352  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 179819us
I20260709 12:15:35.775621  8800 consensus_queue.cc:1048] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:15:35.975409  8332 raft_consensus.cc:1240] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:35.978183  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:35.979044  8331 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:35.996379  8296 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:35.833258  9019 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.973477  8979 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.007850  9014 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.009090  8256 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:15:36.009503  9062 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:36.010151  8526 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
W20260709 12:15:35.995105  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 284349us
I20260709 12:15:36.011569  8446 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:35.973979  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 140429us
I20260709 12:15:36.014385  8943 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.016398  8397 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:36.017977  8404 raft_consensus.cc:1275] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:36.019323  9058 log.cc:927] Time spent T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:15:36.020583  8974 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.022677  9009 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:36.026811  9055 log.cc:927] Time spent T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.394s	user 0.011s	sys 0.000s
W20260709 12:15:36.026966  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.028030  8961 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:35.962841  8962 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.820861  8981 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.044772  9062 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:35.977315  8967 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:36.039090  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 216526us
I20260709 12:15:36.002959  8957 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.042377  8256 pending_rounds.cc:85] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Aborting all ops after (but not including) 0
I20260709 12:15:35.834249  9025 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.100100  8256 pending_rounds.cc:107] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:15:36.100471  8256 raft_consensus.cc:2889] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:36.100627  8248 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.063525  8962 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.102043  9025 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.033411  8220 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:36.072345  8369 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:36.082223  8370 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:36.082494  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.083418  8973 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.048170  8979 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:36.065099  8800 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:36.086597  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:36.072213  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 60731.9us
I20260709 12:15:36.065430  8892 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.053105  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:36.054205  8956 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:15:36.097617  8326 raft_consensus.cc:1275] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:36.099424  9057 log.cc:927] Time spent T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:15:36.073091  9062 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:36.122748  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:36.105978  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 72727.9us
I20260709 12:15:36.098387  9066 consensus_queue.cc:1059] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:15:36.096369  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 165) took 1147 ms. Trace:
I20260709 12:15:36.106411  8957 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.107860  8253 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.108654  8993 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:36.136373  8222 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.064718  9014 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.115850  8471 raft_consensus.cc:2393] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:36.111647  9031 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:36.113643  8892 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.106894  8967 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:36.161689  9065 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:36.119364  9025 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.108836  8370 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:36.118054  8479 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
W20260709 12:15:36.140798  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.119261  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.112752  8979 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.164474  8957 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.134308  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.113833  8800 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.162889  8974 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.162297  9031 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:36.164762  8892 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.165014  8993 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:36.131953  8446 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.200273  9071 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.132503  8325 rpcz_store.cc:276] 0709 12:15:34.948826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.951319 (+  2493us) service_pool.cc:224] Handling call
0709 12:15:35.223077 (+271758us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:36.096160 (+873083us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540046c654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:36.096282 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490198784}
I20260709 12:15:36.201570  8981 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.201694  9063 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.202435  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.203258  8325 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:36.203712  8979 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.186507  8256 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:36.224177  8967 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.195335  9031 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.189443  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.197333  8961 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.229671  8220 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.172792  9025 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.205484  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.239367  8528 tablet_bootstrap.cc:654] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.234113  8888 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.196100  8974 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.254220  8526 tablet_bootstrap.cc:654] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.243459  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.038753  9019 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.241400  8956 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.242480  9018 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:36.266084  8527 tablet_bootstrap.cc:492] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:36.266700  8527 ts_tablet_manager.cc:1403] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.745s	user 0.052s	sys 0.072s
I20260709 12:15:36.243427  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.162163  9014 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.243611  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:36.241436  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 122274us
I20260709 12:15:36.242784  8961 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.268867  8325 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:36.261715  8888 raft_consensus.cc:697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:36.291577  8800 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.285926  8943 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.292404  9067 log.cc:927] Time spent T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:15:36.267956  9018 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.268352  8248 raft_consensus.cc:1275] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:36.268337  8329 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:36.283502  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 179843us
I20260709 12:15:36.297278  9018 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.294865  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:36.297407  8446 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:36.306100  8974 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.306402  8800 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.306967  8800 raft_consensus.cc:697] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:36.307874  8800 consensus_queue.cc:237] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.312041  9019 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.313047  9020 consensus_queue.cc:1048] T 31de02a86b3d49d1af63827598c1a76a P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:36.312064  8446 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.270262  8956 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.315457  8446 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:36.317132  8982 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.317981  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.264107  8993 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.298800  8943 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.319841  8332 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.319795  8220 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.320317  8944 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.333986  8254 raft_consensus.cc:1275] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:36.334319  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.343218  8257 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:36.343765  8250 raft_consensus.cc:1275] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:36.344817  8323 raft_consensus.cc:1240] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:36.344929  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.346258  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.347038  9070 raft_consensus.cc:3055] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:36.347435  9070 raft_consensus.cc:740] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:36.348253  9070 consensus_queue.cc:260] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.349427  9070 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.349507  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:36.350386  8405 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:36.322201  8888 consensus_queue.cc:237] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.337066  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.337399  8255 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:36.328329  8945 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:36.352298  8945 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:36.352396  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:36.352746  8945 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.352893  8475 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.353119  8404 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:36.354326  8961 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.355607  8222 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:36.338932  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.356956  8970 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:36.357368  8970 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.357602  8471 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:36.357735  8970 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.339418  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.358935  8477 raft_consensus.cc:2393] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:36.340060  9014 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.359930  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:36.360956  8943 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:36.362643  8222 leader_election.cc:343] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.365993  8152 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37604 (request call id 94) took 1738 ms. Trace:
I20260709 12:15:36.366449  8152 rpcz_store.cc:276] 0709 12:15:34.670938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.672899 (+  1961us) service_pool.cc:224] Handling call
0709 12:15:36.365916 (+1693017us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 12:15:36.332949  8220 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.376107  8296 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.322440  8951 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 12:15:36.382879  9009 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:36.405579  9009 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.376960  8974 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:36.407814  8155 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37602 (request call id 74) took 2136 ms. Trace:
I20260709 12:15:36.380788  9037 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.381460  9020 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.381112  8964 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:36.331298  8370 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:36.418175  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 80029.3us
I20260709 12:15:36.422022  8443 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.381003  9006 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:36.407518  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.429219  8398 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:36.431190  8800 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.444314  8800 raft_consensus.cc:697] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:36.444661  8945 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.445935  8800 consensus_queue.cc:237] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:36.417349  9060 consensus_meta.cc:287] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
I20260709 12:15:36.447248  9060 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.408456  9009 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.449160  8528 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c: No bootstrap required, opened a new log
I20260709 12:15:36.406605  8954 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:15:36.449769  8528 ts_tablet_manager.cc:1403] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c: Time spent bootstrapping tablet: real 0.756s	user 0.015s	sys 0.015s
I20260709 12:15:36.411630  8974 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.451234  8979 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.432682  8969 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:36.452221  8969 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.453377  8528 raft_consensus.cc:359] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.454080  8528 raft_consensus.cc:385] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.454346  8528 raft_consensus.cc:740] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.451258  8974 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.455060  8527 raft_consensus.cc:359] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.455775  8527 raft_consensus.cc:385] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.456024  8527 raft_consensus.cc:740] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.456684  8527 consensus_queue.cc:260] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.458336  8956 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.459174  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:36.460722  8297 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.416534  8964 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.454923  8528 consensus_queue.cc:260] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.462941  8964 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.463999  8528 ts_tablet_manager.cc:1434] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:15:36.462208  8974 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.467326  8974 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:36.438390  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 115524us
I20260709 12:15:36.416253  9025 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.419718  9020 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.440164  8963 consensus_queue.cc:1048] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.422446  8962 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.470599  8297 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:36.494870  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 115956us
I20260709 12:15:36.495688  9006 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.496335  9006 raft_consensus.cc:697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:36.497200  9006 consensus_queue.cc:237] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:36.442881  9062 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.498513  8962 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:36.478679  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:36.502576  8331 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.462597  8892 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.416896  9037 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.487917  8370 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:36.410079  8155 rpcz_store.cc:276] 0709 12:15:34.271443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.271609 (+   166us) service_pool.cc:224] Handling call
0709 12:15:36.407753 (+2136144us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:34.794220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:34.794806 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:34.794844 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:15:34.794864 (+    20us) tablet.cc:662] Decoding operations
0709 12:15:34.795208 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:34.795261 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:34.795291 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:34.795472 (+   181us) tablet.cc:701] Row locks acquired
0709 12:15:34.795490 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:34.795665 (+   175us) write_op.cc:270] Start()
0709 12:15:34.795771 (+   106us) write_op.cc:276] Timestamp: P: 1783599334795624 usec, L: 0
0709 12:15:34.795790 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:15:34.796474 (+   684us) log.cc:844] Serialized 537 byte log entry
0709 12:15:35.589122 (+792648us) op_driver.cc:464] REPLICATION: finished
0709 12:15:35.658898 (+ 69776us) write_op.cc:301] APPLY: starting
0709 12:15:35.659025 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:35.659150 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:35.659303 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:35.659577 (+   274us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:35.659809 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:15:35.659874 (+    65us) write_op.cc:312] APPLY: finished
0709 12:15:35.660096 (+   222us) log.cc:844] Serialized 22 byte log entry
0709 12:15:35.660957 (+   861us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:35.661047 (+    90us) write_op.cc:454] Released schema lock
0709 12:15:35.661090 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:35.662498 (+  1408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:35.662542 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":656977,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":69493,"apply.run_cpu_time_us":1933,"apply.run_wall_time_us":3582,"num_ops":1,"prepare.queue_time_us":171214,"prepare.run_cpu_time_us":20817,"prepare.run_wall_time_us":317827,"raft.queue_time_us":336226,"raft.run_cpu_time_us":14257,"raft.run_wall_time_us":120194,"replication_time_us":777477,"thread_start_us":606402,"threads_started":4,"wal-append.queue_time_us":332148}]]}
I20260709 12:15:36.499683  9062 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.500489  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:36.494024  8527 ts_tablet_manager.cc:1434] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.227s	user 0.007s	sys 0.000s
I20260709 12:15:36.469893  8970 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.506187  8945 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:36.510955  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 114071us
I20260709 12:15:36.504748  8251 raft_consensus.cc:2368] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
I20260709 12:15:36.462146  9031 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.493404  8944 raft_consensus.cc:697] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:36.520547  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 95973.8us
I20260709 12:15:36.687475  9062 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:36.685190  8973 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.743486  9062 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.743600  8973 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.745781  9062 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.689357  9014 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.690934  8943 consensus_queue.cc:1048] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:36.746483  9014 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.747736  8892 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.749155  9014 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.749449  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.746068  8973 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:36.750238  8476 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.691964  8964 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.752167  9019 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.752732  9019 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.692824  8970 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:36.693017  8969 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.694514  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.696165  9025 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.756158  9019 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.756237  9025 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.696239  8961 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.759505  8961 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.759924  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.760602  8476 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.761648  8961 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:36.695814  8979 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:36.696686  9081 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.688174  8151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37620 (request call id 74) took 2215 ms. Trace:
I20260709 12:15:36.697274  9018 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.698077  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:36.763629  9081 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.767911  8253 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.698576  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:36.699867  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.770529  8473 raft_consensus.cc:2393] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:36.770424  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 75981.8us
I20260709 12:15:36.702054  8986 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.700027  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.705528  8249 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
W20260709 12:15:36.709837  8297 leader_election.cc:343] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:36.771739  8986 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:36.694146  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 206324us
I20260709 12:15:36.716419  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.722704  9066 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.697829  8944 consensus_queue.cc:237] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:36.738668  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.702797  9022 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.741768  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.739743  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 119) took 1006 ms. Trace:
I20260709 12:15:36.691572  9009 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.755659  8248 raft_consensus.cc:2393] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:36.758818  9025 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:36.763600  8151 rpcz_store.cc:276] 0709 12:15:34.473102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:34.473249 (+   147us) service_pool.cc:224] Handling call
0709 12:15:36.688106 (+2214857us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375487,"reported_tablets":1}
I20260709 12:15:36.769556  9081 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.764292  8256 raft_consensus.cc:2368] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
W20260709 12:15:36.685976  9079 log.cc:927] Time spent T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.004s
W20260709 12:15:36.772092  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 62342.3us
I20260709 12:15:36.719381  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:36.723747  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.782954  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.783144  8479 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.774099  8986 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.784391  8398 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.774466  9066 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.786406  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.787091  8480 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.788730  9066 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.789703  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.790706  8479 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:36.777240  8472 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.777738  8478 raft_consensus.cc:2468] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:36.793272  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.793959  8479 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.776194  8943 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:36.777601  9022 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.800760  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.801487  8472 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.804709  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.805487  8471 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:36.786013  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:36.777855  8251 rpcz_store.cc:276] 0709 12:15:35.732871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:35.734674 (+  1803us) service_pool.cc:224] Handling call
0709 12:15:36.344768 (+610094us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:36.738070 (+393302us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540053ded4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:36.739618 (+  1548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300643968}
I20260709 12:15:36.796530  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.797192  8943 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:36.773989  8250 raft_consensus.cc:2393] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:36.766187  9018 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.824877  8480 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:36.842840  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.855691  8221 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.875149  8256 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:36.864859  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:36.871795  8479 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:36.813474  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:36.880052  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 59656.7us
I20260709 12:15:36.882527  8331 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:36.883718  8298 leader_election.cc:400] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
I20260709 12:15:36.884608  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:36.885301  8405 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:36.885403  8221 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:36.885792  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.886195  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.890941  8480 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:36.891444  8479 raft_consensus.cc:2393] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:36.888566  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.892081  8478 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:36.884087  8298 leader_election.cc:403] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:36.893716  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 48014us
I20260709 12:15:36.894969  8298 leader_election.cc:400] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
I20260709 12:15:36.897007  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.898082  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:36.898729  8480 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:36.901573  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.902599  8331 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 0.
I20260709 12:15:36.903831  8443 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.895299  8298 leader_election.cc:403] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:36.905867  8298 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:36.900218  8222 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:36.898736  8296 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:36.874174  8982 consensus_meta.cc:287] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.005s
I20260709 12:15:36.908143  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.917414  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:36.856977  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:36.831946  9031 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.854943  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.781306  9009 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.854622  8943 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.822542  9081 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:15:36.895282  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:36.810973  9037 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:36.935521  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:36.964877  8332 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.879328  9022 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:36.878520  8973 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.906885  8986 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.856591  8476 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:36.815786  9020 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:36.898787  8962 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:36.946309  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 48042.1us
I20260709 12:15:36.895776  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:36.908883  8961 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.965405  8956 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:36.950263  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:37.026682  8330 raft_consensus.cc:2368] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3.
I20260709 12:15:37.027647  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:36.951138  8527 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:36.912979  8967 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.872234  8888 consensus_queue.cc:1048] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:15:36.921888  9019 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.898890  9014 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
I20260709 12:15:37.019075  8963 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.920820  9006 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.952879  8251 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.944835  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:36.942536  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:36.990001  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:36.943958  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:36.987988  8973 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:36.961162  8248 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
W20260709 12:15:36.993062  8445 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:37.120394  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 128184us
W20260709 12:15:37.121485  8445 consensus_peers.cc:597] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.966316  9031 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:36.987722  8969 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:37.026480  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:37.076898  8963 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.059854  8526 tablet_bootstrap.cc:492] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:36.908119  8471 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:37.074743  8332 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:37.003243  9083 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:37.026285  8956 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.088091  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 202752us
I20260709 12:15:37.120430  8475 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:37.120616  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.023934  8249 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:37.132962  8969 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.075541  9019 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:36.998318  8962 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.060094  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.083220  9006 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.059428  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 160762us
I20260709 12:15:37.141592  8526 ts_tablet_manager.cc:1403] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 1.145s	user 0.017s	sys 0.037s
I20260709 12:15:37.083773  9009 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.127477  8406 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
W20260709 12:15:37.159873  9088 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:15:37.168807  8969 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:37.226174  8405 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.145504  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:37.150457  8221 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:37.002715  8961 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:36.949273  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 45504.6us
I20260709 12:15:37.039157  8473 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.145205  8963 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.142599  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.169497  8257 raft_consensus.cc:2393] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:37.177160  8296 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:37.151872  8956 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.178923  9006 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.227346  8982 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:37.151986  9083 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.184252  9009 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:37.238704  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 88332.8us
I20260709 12:15:37.277045  8221 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:37.144745  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 244499us
I20260709 12:15:37.281538  8221 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:37.238114  8526 raft_consensus.cc:359] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.297420  8526 raft_consensus.cc:385] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.286628  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.297856  8526 raft_consensus.cc:740] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.298141  8405 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:37.298859  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:37.300321  8222 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:37.238400  8332 raft_consensus.cc:2393] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:37.249373  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 72320.9us
I20260709 12:15:37.314739  8527 tablet_bootstrap.cc:654] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.342640  9098 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.252486  9019 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:37.240468  8961 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:37.249992  9092 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.240671  9094 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:37.321354  8970 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.346779  8526 consensus_queue.cc:260] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.247414  8323 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:37.266219  8327 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:37.242168  8398 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:37.368371  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.345687  9031 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:37.280189  9014 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:15:37.345021  8973 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.375082  9098 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.391180  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:37.395216  8974 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.399086  8962 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.403640  8473 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.376123  9097 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:37.321666  9095 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:37.373576  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:37.375483  9009 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:37.428503  8222 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.406584  8961 raft_consensus.cc:2804] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.463240  8961 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.463851  8961 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.377765  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.467535  8329 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:37.469125  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.470103  8329 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:37.253541  8982 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:37.342425  9093 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.471583  9093 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.384754  9092 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.451656  9009 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.473913  9009 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.443435  8974 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:37.475394  8954 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:37.476114  8954 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.388903  8372 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:37.409183  9031 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.409796  8986 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:37.460322  8956 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:37.451732  8254 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:37.515523  8256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.016s	sys 0.031s
W20260709 12:15:37.516062  8256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.016s	sys 0.031s
I20260709 12:15:37.455433  8222 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:37.517441  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 62172.3us
I20260709 12:15:37.404191  8970 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.447701  9097 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.505880  8943 consensus_meta.cc:287] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.006s
I20260709 12:15:37.450117  9083 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.481375  8967 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3.
W20260709 12:15:37.520908  8944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.016s	sys 0.031s
I20260709 12:15:37.529268  9009 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.530398  8956 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:37.531282  8330 raft_consensus.cc:2393] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:37.538951  8944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.019s	sys 0.032s
W20260709 12:15:37.537909  8800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.020s	sys 0.041s
I20260709 12:15:37.548530  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:37.548980  8800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.021s	sys 0.041s
I20260709 12:15:37.523859  9094 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:37.549908  9094 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:37.550923  9094 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.512667  9031 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.521857  9096 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:37.524276  8993 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:37.520543  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 143429us
I20260709 12:15:37.565760  8331 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:37.523413  9097 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:37.566653  8399 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:37.525837  8943 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:37.574416  8253 consensus_meta.cc:287] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.805s	user 0.015s	sys 0.002s
W20260709 12:15:37.574263  8326 consensus_meta.cc:287] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.010s
I20260709 12:15:37.567423  8993 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.570384  8974 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:37.601207  8446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.052s	sys 0.047s
I20260709 12:15:37.574784  8329 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:37.574519  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:37.603116  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 314307us
W20260709 12:15:37.578928  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 297465us
I20260709 12:15:37.614609  8221 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:37.582438  8472 consensus_meta.cc:287] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.005s
W20260709 12:15:37.611666  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 349681us
W20260709 12:15:37.605806  8446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.052s	sys 0.047s
I20260709 12:15:37.617307  8221 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:37.584344  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.620642  8296 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:37.618269  8220 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:37.575452  8963 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.631855  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:37.635705  8405 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.605532  8993 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:37.604598  8982 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:37.629918  8944 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.591594  8253 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:37.603344  8326 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:37.613425  8974 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.627280  9022 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:37.626415  9083 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.626375  8973 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.627436  8472 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:37.637842  9009 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:37.631098  8956 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.632038  9066 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.643446  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.659898  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:37.629535  8401 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:37.644399  8398 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:37.653151  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.700316  8405 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:37.668831  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 126) took 1152 ms. Trace:
I20260709 12:15:37.660821  9022 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.704520  9083 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.660243  8326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 71) took 1147 ms. Trace:
I20260709 12:15:37.688609  9098 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.715658  8526 ts_tablet_manager.cc:1434] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.539s	user 0.019s	sys 0.022s
I20260709 12:15:37.653466  8944 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.761868  8222 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:37.689328  9112 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:37.689198  8969 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:37.708493  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.732849  9113 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:37.734519  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 73719.2us
I20260709 12:15:37.706212  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:37.759033  8526 ts_tablet_manager.cc:1467] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Tablet startup took 581ms
I20260709 12:15:37.701772  9111 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:37.660459  8974 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.736841  8254 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:37.714679  9107 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.774600  8527 tablet_bootstrap.cc:492] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:37.707852  8973 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.707446  9006 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.777343  9113 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:37.772109  8526 ts_tablet_manager.cc:1469] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Trace:
0709 12:15:24.112106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.112294 (+   188us) service_pool.cc:224] Handling call
0709 12:15:24.114095 (+  1801us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:24.114189 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:24.125772 (+ 11583us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:24.136056 (+ 10284us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:24.159746 (+ 23690us) inbound_call.cc:177] Queueing success response
0709 12:15:35.918809 (+11759063us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:15:37.177121 (+1258312us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:15:37.180370 (+  3249us) tablet_replica.cc:261] Starting instrumentation
0709 12:15:37.180919 (+   549us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":155498,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"tablet-open.queue_time_us":11759052,"thread_start_us":240768,"threads_started":1}
I20260709 12:15:37.709123  8956 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.739486  9109 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.741554  9022 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.781529  8527 ts_tablet_manager.cc:1403] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.866s	user 0.028s	sys 0.037s
I20260709 12:15:37.757462  8970 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:37.712846  9066 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:37.771231  9100 log.cc:927] Time spent T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:15:37.805958  8446 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:37.789947  9025 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:37.781175  8297 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:37.706883  9009 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:37.790067  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 169568us
I20260709 12:15:37.739373  8399 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:37.769485  8964 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:37.756943  9020 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:15:37.776081  9116 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.781558  8892 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.727645  8253 rpcz_store.cc:276] 0709 12:15:36.503991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.504460 (+   469us) service_pool.cc:224] Handling call
0709 12:15:37.653647 (+1149187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:37.783486  9111 raft_consensus.cc:697] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:37.800945  9109 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.808995  9095 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:37.799118  8475 consensus_meta.cc:287] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.006s
W20260709 12:15:37.811684  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 193460us
I20260709 12:15:37.793031  8943 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:37.782737  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 146704us
I20260709 12:15:37.805744  8257 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.883626  8220 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:37.795109  9104 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.790827  9122 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.823987  8446 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:37.784133  9107 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:37.827621  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 46569.8us
W20260709 12:15:37.817077  9103 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:15:37.860356  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 46340.2us
I20260709 12:15:37.760982  8326 rpcz_store.cc:276] 0709 12:15:36.509286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.510740 (+  1454us) service_pool.cc:224] Handling call
0709 12:15:37.656807 (+1146067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:37.821846  9112 raft_consensus.cc:697] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:37.893916  8220 leader_election.cc:400] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3.
I20260709 12:15:37.895401  8220 leader_election.cc:403] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:15:37.812292  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.815742  8324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 234) took 1047 ms. Trace:
I20260709 12:15:37.797822  9113 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.823681  8800 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:37.827050  8892 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.919982  8892 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:37.824404  9116 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.884176  9095 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:37.826601  8963 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:37.879469  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:37.880024  8964 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:37.879751  8475 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:37.882934  9123 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:37.902181  8954 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.896575  8982 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:37.904312  9110 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.956385  8369 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:37.929827  9106 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:15:37.963765  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 140162us
I20260709 12:15:37.957338  8254 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:37.927675  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:37.926484  8329 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:37.885504  9119 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:37.901561  8967 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:15:37.944103  8892 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.927863  9117 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:37.944577  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:37.903045  9104 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.958767  9127 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:37.966732  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 152) took 1074 ms. Trace:
I20260709 12:15:37.968137  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:37.952852  8964 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:37.901863  9122 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.972971  9121 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:38.001785  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:38.002066  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 118) took 1097 ms. Trace:
I20260709 12:15:37.967231  8982 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:37.987907  9133 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:38.001713  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 107941us
I20260709 12:15:37.975903  8954 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:15:37.991905  8944 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.013585  8220 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:38.004428  8251 consensus_meta.cc:287] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.876s	user 0.014s	sys 0.002s
I20260709 12:15:37.996333  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:37.994305  8400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 174) took 1117 ms. Trace:
I20260709 12:15:38.004976  8256 rpcz_store.cc:276] 0709 12:15:36.899381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.900317 (+   936us) service_pool.cc:224] Handling call
0709 12:15:36.921898 (+ 21581us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:36.922111 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:36.935429 (+ 13318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:36.935459 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:36.935959 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:15:37.516662 (+580703us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:37.516721 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.516823 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:37.996183 (+479360us) raft_consensus.cc:1685] finished
0709 12:15:37.996213 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.996468 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12932,"raft.queue_time_us":56900,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":14923,"spinlock_wait_cycles":16146688,"thread_start_us":580362,"threads_started":1,"wal-append.queue_time_us":701811}
I20260709 12:15:38.027469  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:37.999356  8473 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.003402  9083 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:37.912397  8324 rpcz_store.cc:276] 0709 12:15:36.764998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.765166 (+   168us) service_pool.cc:224] Handling call
0709 12:15:37.739613 (+974447us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:37.768699 (+ 29086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:37.781259 (+ 12560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:37.790707 (+  9448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:37.793052 (+  2345us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:37.797374 (+  4322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.801125 (+  3751us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:37.812514 (+ 11389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26720128}
I20260709 12:15:37.998651  9127 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.039547  8974 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.040140  8974 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.040591  8974 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:37.973618  9110 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.043282  8297 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:38.012475  8892 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:38.039359  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:37.994810  9117 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.033766  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.033629  8326 raft_consensus.cc:2393] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:38.041464  9127 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.049957  8256 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:37.996768  8475 rpcz_store.cc:276] 0709 12:15:36.884819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.896113 (+ 11294us) service_pool.cc:224] Handling call
0709 12:15:37.955023 (+1058910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:38.058229  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:38.041797  8969 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:38.061575  9105 log.cc:927] Time spent T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:15:38.061800  8969 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:38.062431  9107 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:37.983999  9119 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.063588  9116 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.065071  9119 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.065450  9117 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.053728  8404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 170) took 1191 ms. Trace:
I20260709 12:15:38.066056  9117 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.066468  9113 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.067359  8974 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.067469  9066 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.068114  9066 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.068544  9066 raft_consensus.cc:697] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:38.028368  8251 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:38.045110  9006 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.102278  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.111545  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.112416  8479 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.052311  9009 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:37.976536  9112 consensus_queue.cc:237] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.117097  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.045491  8892 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.059453  8956 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.119606  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:38.122303  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 166007us
I20260709 12:15:38.066690  9117 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.010571  9121 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:37.980614  9111 consensus_queue.cc:237] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.108103  8969 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3.
W20260709 12:15:38.113021  9103 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:38.100270  9107 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.069370  9066 consensus_queue.cc:237] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:38.059043  8474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 84) took 1161 ms (client timeout 1547 ms). Trace:
I20260709 12:15:38.113533  9116 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.115018  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 129) took 1269 ms. Trace:
I20260709 12:15:38.136124  9009 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.168083  9009 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.136705  8956 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:38.136845  8961 consensus_meta.cc:287] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.672s	user 0.014s	sys 0.000s
I20260709 12:15:38.107614  9113 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.171533  8956 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.171784  9113 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.172014  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.172986  8323 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:38.173708  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 238) took 1331 ms. Trace:
I20260709 12:15:38.106659  9123 raft_consensus.cc:697] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:38.137202  9108 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.065580  9135 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.031225  8400 rpcz_store.cc:276] 0709 12:15:36.866074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.871596 (+  5522us) service_pool.cc:224] Handling call
0709 12:15:37.911336 (+1039740us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:37.983220 (+ 71884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13069696}
I20260709 12:15:38.023453  9133 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.122784  8892 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.141404  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 190) took 1313 ms. Trace:
I20260709 12:15:38.147716  9140 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.148278  9129 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.148904  9134 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.149541  9025 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.200050  9025 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.200627  9122 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.202468  9117 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.066478  8404 rpcz_store.cc:276] 0709 12:15:36.861433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.871411 (+  9978us) service_pool.cc:224] Handling call
0709 12:15:36.937362 (+ 65951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:36.979020 (+ 41658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:36.987969 (+  8949us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:37.082447 (+ 94478us) log.cc:844] Serialized 26 byte log entry
0709 12:15:37.418238 (+335791us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:37.765726 (+347488us) log.cc:844] Serialized 14 byte log entry
0709 12:15:37.780740 (+ 15014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:37.791743 (+ 11003us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.035709 (+243966us) raft_consensus.cc:1685] finished
0709 12:15:38.035739 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.052759 (+ 17020us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140171,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":5817,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19484,"thread_start_us":509507,"threads_started":2,"wal-append.queue_time_us":492146}
I20260709 12:15:38.131640  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:38.204000  8475 raft_consensus.cc:2393] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 1: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:38.143036  8474 rpcz_store.cc:269] 0709 12:15:36.897572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.907384 (+  9812us) service_pool.cc:224] Handling call
0709 12:15:37.989443 (+1082059us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.053658 (+ 64215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9747200}
I20260709 12:15:38.207481  9145 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.207252  9140 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.208045  9145 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.209646  9129 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.210901  8982 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.211552  8982 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.211984  9129 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.146062  8251 rpcz_store.cc:276] 0709 12:15:36.843624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.856654 (+ 13030us) service_pool.cc:224] Handling call
0709 12:15:38.112541 (+1255887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:38.212952  9104 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.213347  9133 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.211995  8982 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.190798  8327 rpcz_store.cc:276] 0709 12:15:36.826772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.001502 (+174730us) service_pool.cc:224] Handling call
0709 12:15:38.127886 (+1126384us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54003c9bd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:38.139873 (+ 11987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197748480}
I20260709 12:15:38.171558  8961 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.143775  9107 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.216189  8254 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:38.216741  8961 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.189769  9135 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.217711  8248 raft_consensus.cc:2393] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:38.221045  9121 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.182247  9108 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.221586  8328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 74) took 1416 ms. Trace:
I20260709 12:15:38.222009  9108 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.223271  8964 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:38.224161  8993 consensus_meta.cc:287] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:15:38.224745  8993 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.174804  9123 consensus_queue.cc:237] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.228735  9092 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.233294  8155 catalog_manager.cc:5697] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 1 to 2, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
I20260709 12:15:38.235606  8155 catalog_manager.cc:5697] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 1 to 2, leader changed from b3421ee20b674b879e0633e39c5709d7 (127.3.34.195) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } }
W20260709 12:15:38.167368  9097 consensus_meta.cc:287] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.003s
I20260709 12:15:38.239904  8296 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.173766  9113 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:38.126391  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 112873us
I20260709 12:15:38.174242  8323 rpcz_store.cc:276] 0709 12:15:36.842024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.449014 (+606990us) service_pool.cc:224] Handling call
0709 12:15:38.171837 (+722823us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.173626 (+  1789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13966592}
I20260709 12:15:38.183368  8527 raft_consensus.cc:359] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.256369  8527 raft_consensus.cc:385] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.256721  8527 raft_consensus.cc:740] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.143679  9116 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.203233  9117 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:38.162199  8331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 240) took 1316 ms (client timeout 1719 ms). Trace:
I20260709 12:15:38.249176  8296 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.237422  8155 catalog_manager.cc:5697] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } }
I20260709 12:15:38.250649  8220 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:38.286862  8220 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.287369  8220 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:38.290802  8298 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:38.268491  8527 consensus_queue.cc:260] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.226575  9022 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:38.276867  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 233667us
I20260709 12:15:38.247841  9133 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:38.276652  8331 rpcz_store.cc:269] 0709 12:15:36.845501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.917138 (+ 71637us) service_pool.cc:224] Handling call
0709 12:15:38.161952 (+1244814us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54008462d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:38.162105 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438468352}
W20260709 12:15:38.295285  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 46214.6us
I20260709 12:15:38.269636  9121 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:38.222103  8328 rpcz_store.cc:276] 0709 12:15:36.805349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.855750 (+ 50401us) service_pool.cc:224] Handling call
0709 12:15:37.512190 (+656440us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:38.220737 (+708547us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:38.220941 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.221127 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.221155 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.221287 (+   132us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.221327 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.221387 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.221497 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41543424}
I20260709 12:15:38.247478  9109 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.270586  9116 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.314261  8296 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.297124  8964 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.324929  8443 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.296592  8974 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.318303  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.250950  9097 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.337160  8331 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:38.291956  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 120) took 1387 ms. Trace:
I20260709 12:15:38.296844  8970 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.301826  9113 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:38.348591  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.273952  9122 consensus_queue.cc:1048] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:15:38.245811  9134 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.353525  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:38.359241  9134 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.329838  9121 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.359898  9121 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.361356  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.362304  9125 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.362552  9124 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.293247  9117 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:38.315759  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.352691  8331 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:38.356235  8370 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:38.362604  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.388739  8256 raft_consensus.cc:2393] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:38.363257  9148 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.362941  9125 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.363539  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.363787  9087 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.364065  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.364435  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.366197  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.329921  9092 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.302205  9129 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.386665  8220 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.341081  8970 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.330672  9133 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.354745  9109 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.409106  8970 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.413280  9134 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.413810  9134 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.402154  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.416030  9134 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.416220  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.417073  8480 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.404101  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.418087  8296 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.400279  9113 raft_consensus.cc:697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:38.417991  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.421975  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.390944  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:38.438577  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:38.364061  9146 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.350657  9139 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.400674  8323 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:38.391996  9087 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.399798  8474 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.406867  9140 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.407591  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.468314  8527 ts_tablet_manager.cc:1434] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.669s	user 0.012s	sys 0.010s
I20260709 12:15:38.420116  9109 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.406585  9157 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.411473  8964 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:38.406841  8404 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:38.471284  8405 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.463343  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.419875  9129 raft_consensus.cc:697] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:38.421550  9119 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.514452  9119 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.420689  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.440140  9134 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.429064  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.521416  9125 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.400075  9148 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:38.499414  8527 ts_tablet_manager.cc:1467] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Tablet startup took 699ms
I20260709 12:15:38.514902  9133 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:38.420920  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 64849.8us
I20260709 12:15:38.421396  9006 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:38.440421  9066 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.408718  9092 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.500873  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.493672  9087 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.394510  9124 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.507704  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.509528  9140 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:38.504607  9031 consensus_meta.cc:287] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.932s	user 0.008s	sys 0.006s
I20260709 12:15:38.471129  8399 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.503273  9109 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.505769  9160 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:38.522595  8527 ts_tablet_manager.cc:1469] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Trace:
0709 12:15:23.775750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.775921 (+   171us) service_pool.cc:224] Handling call
0709 12:15:23.809790 (+ 33869us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:23.809911 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:23.916200 (+106289us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:23.960457 (+ 44257us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:23.960990 (+   533us) inbound_call.cc:177] Queueing success response
0709 12:15:36.881455 (+12920465us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:15:37.799663 (+918208us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:15:38.109819 (+310156us) tablet_replica.cc:261] Starting instrumentation
0709 12:15:38.118803 (+  8984us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":171532,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":44467,"tablet-open.queue_time_us":12920528,"thread_start_us":138083,"threads_started":1}
I20260709 12:15:38.515607  8964 raft_consensus.cc:697] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:38.518898  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.519173  9134 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.524055  9163 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.463457  9146 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.533072  9140 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.530202  9006 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.560520  8964 consensus_queue.cc:237] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.549539  9134 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.529989  9066 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.561820  9124 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.550218  9022 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.554126  9140 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.497576  9139 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.564244  9148 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.510773  9157 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.527163  9113 consensus_queue.cc:237] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.572293  9092 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.697052  9006 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.521989  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.622884  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.623135  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.712051  8252 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.713557  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:38.713718  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.511286  8296 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:38.508496  8297 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:38.715518  8297 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:38.627548  8298 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:38.526249  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:38.716566  9095 consensus_meta.cc:287] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
I20260709 12:15:38.717463  8323 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:38.717499  9095 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.503108  8328 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:38.720361  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:38.721446  8328 raft_consensus.cc:2393] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 1: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:38.722493  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:38.631349  8370 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:38.632490  8372 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:38.512884  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.730068  8397 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.468242  8326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 192) took 1637 ms. Trace:
I20260709 12:15:38.502787  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.524264  8401 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.634644  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 193) took 1779 ms. Trace:
I20260709 12:15:38.731714  8326 rpcz_store.cc:276] 0709 12:15:36.827307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.068879 (+1241572us) service_pool.cc:224] Handling call
0709 12:15:38.069226 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.069446 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:38.191541 (+122095us) log.cc:844] Serialized 14 byte log entry
0709 12:15:38.404096 (+212555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.409626 (+  5530us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.412342 (+  2716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.429890 (+ 17548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.464415 (+ 34525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3848,"prepare.queue_time_us":222399,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":12972,"spinlock_wait_cycles":5733248,"thread_start_us":243539,"threads_started":2,"wal-append.queue_time_us":305311}
I20260709 12:15:38.733209  8327 rpcz_store.cc:276] 0709 12:15:36.854734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.214971 (+1360237us) service_pool.cc:224] Handling call
0709 12:15:38.215380 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.215766 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.215799 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:38.216305 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:15:38.464009 (+247704us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:38.469167 (+  5158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.494253 (+ 25086us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.633861 (+139608us) raft_consensus.cc:1685] finished
0709 12:15:38.633906 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.634328 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5940,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":133234,"threads_started":1,"wal-append.queue_time_us":267692}
I20260709 12:15:38.735759  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.736819  8327 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:38.738164  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.636286  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 191) took 1809 ms. Trace:
I20260709 12:15:38.723534  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:38.739610  9025 consensus_meta.cc:287] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 12:15:38.543330  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.341364  8249 rpcz_store.cc:276] 0709 12:15:36.907761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.173774 (+266013us) service_pool.cc:224] Handling call
0709 12:15:37.550958 (+377184us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:37.572564 (+ 21606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:37.613240 (+ 40676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:37.626145 (+ 12905us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:37.645094 (+ 18949us) log.cc:844] Serialized 26 byte log entry
0709 12:15:37.782798 (+137704us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:37.888393 (+105595us) log.cc:844] Serialized 14 byte log entry
0709 12:15:38.007661 (+119268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.012901 (+  5240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.169387 (+156486us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b180033f9a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:15:38.256601 (+ 87214us) raft_consensus.cc:1685] finished
0709 12:15:38.268298 (+ 11697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.287417 (+ 19119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37160,"prepare.queue_time_us":151966,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1781,"raft.queue_time_us":192549,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":14293,"spinlock_wait_cycles":12923520,"thread_start_us":265125,"threads_started":3,"wal-append.queue_time_us":123992}
I20260709 12:15:38.641563  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:38.740222  9025 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.646327  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.741532  8403 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.649150  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.741984  9152 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.742569  9095 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:38.654268  8330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 239) took 1811 ms (client timeout 1997 ms). Trace:
I20260709 12:15:38.656193  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.664171  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.664395  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.665815  8526 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:38.667966  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.669747  8888 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.751962  9133 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:38.752564  9133 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.753057  9133 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.752715  8888 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.673501  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 233) took 1943 ms. Trace:
I20260709 12:15:38.755193  8325 rpcz_store.cc:276] 0709 12:15:36.729822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.730013 (+   191us) service_pool.cc:224] Handling call
0709 12:15:37.739428 (+1009415us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:38.157796 (+418368us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:38.158070 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.219267 (+ 61197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.219302 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.219445 (+   143us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.219486 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.672797 (+453311us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b54005b7554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:38.672877 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.673256 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176916864}
I20260709 12:15:38.756706  9154 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.757632  9154 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:38.675549  8248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 123) took 1766 ms (client timeout 2133 ms). Trace:
I20260709 12:15:38.678016  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.760337  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.761287  8256 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:38.663579  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.666292  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.679629  8369 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:38.684516  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.757841  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.764060  8331 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:38.758674  8248 rpcz_store.cc:269] 0709 12:15:36.908634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.146604 (+237970us) service_pool.cc:224] Handling call
0709 12:15:37.706078 (+559474us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.674909 (+968831us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400517054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:38.675291 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036973824}
I20260709 12:15:38.688578  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.690349  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.762914  8472 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:38.564740  9097 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.567368  9117 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.770114  9117 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.770900  9117 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.773643  9117 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.774221  9117 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:38.580130  9121 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.558302  9129 consensus_queue.cc:237] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.583859  9139 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.576210  9146 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.778088  8332 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:38.778282  9146 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:38.778652  8332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 241) took 1932 ms (client timeout 2372 ms). Trace:
I20260709 12:15:38.778707  9146 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.581480  9157 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.547868  9160 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:38.555661  9163 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.544792  9031 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.702754  9066 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.712040  8250 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:38.725519  8328 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:38.742805  9152 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:38.653252  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:38.747489  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 236153us
W20260709 12:15:38.749255  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 240775us
I20260709 12:15:38.743299  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.779222  9146 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.825919  9135 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.829949  9119 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.714782  8252 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:38.850061  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.852921  8404 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.850229  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.742028  8251 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:38.756577  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.850952  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:38.795727  9107 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:38.743924  8330 rpcz_store.cc:269] 0709 12:15:36.842396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.027401 (+185005us) service_pool.cc:224] Handling call
0709 12:15:38.653599 (+1626198us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400226354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:38.653952 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156007296}
I20260709 12:15:38.799738  9110 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.807459  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.833688  8527 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
W20260709 12:15:38.854880  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 227893us
W20260709 12:15:38.842206  9156 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
I20260709 12:15:38.815786  9009 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.740156  8323 raft_consensus.cc:2393] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:38.779124  8332 rpcz_store.cc:269] 0709 12:15:36.845906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.320449 (+474543us) service_pool.cc:224] Handling call
0709 12:15:37.512986 (+192537us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.655581 (+1142595us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.778556 (+122975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61542528}
I20260709 12:15:38.855022  9117 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:38.798035  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:38.788930  9170 log.cc:927] Time spent T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:15:38.894860  9163 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.813649  8982 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.780236  8888 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:38.894634  9160 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.780520  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.805976  9145 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.819072  8993 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:38.892386  9117 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:38.875948  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.885195  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:38.822533  9093 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.884441  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:38.879453  8250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 122) took 1967 ms (client timeout 2169 ms). Trace:
I20260709 12:15:38.831929  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:38.908416  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 255684us
I20260709 12:15:38.796806  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.888312  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:38.805203  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:38.902671  8406 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:38.809790  8956 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.812835  8974 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:38.936695  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:38.936955  8252 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.003587  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.003921  8445 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.005224  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:38.957307  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 278443us
I20260709 12:15:39.005992  8478 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
W20260709 12:15:39.006119  8220 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.997s (SENT) [suppressed 2 similar messages]
I20260709 12:15:39.006454  8369 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.007042  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.007750  8220 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.010625  9118 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:39.011063  9118 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.011442  9118 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:38.914354  8257 raft_consensus.cc:2393] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:38.977732  8248 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:38.998497  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.018940  8480 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.019197  8252 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:39.019840  9022 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.020293  9022 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:38.998942  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 195) took 2143 ms. Trace:
I20260709 12:15:39.023192  8331 rpcz_store.cc:276] 0709 12:15:36.855401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.765200 (+1909799us) service_pool.cc:224] Handling call
0709 12:15:38.765723 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.766133 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:38.766644 (+   511us) log.cc:844] Serialized 14 byte log entry
0709 12:15:38.994097 (+227453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.994169 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:38.998688 (+  4519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.998760 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.998871 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":65,"raft.queue_time_us":7719,"thread_start_us":220507,"threads_started":1}
I20260709 12:15:39.025947  9025 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.999257  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 198) took 1750 ms. Trace:
I20260709 12:15:39.005172  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.027573  8330 rpcz_store.cc:276] 0709 12:15:37.248878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.904034 (+1655156us) service_pool.cc:224] Handling call
0709 12:15:38.992948 (+ 88914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.998906 (+  5958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.998938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.999025 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:38.999051 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.999105 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.999202 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:38.994638  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.028645  9152 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.029086  8254 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:39.030045  8973 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:38.990252  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 197) took 1737 ms. Trace:
I20260709 12:15:39.033113  8332 rpcz_store.cc:276] 0709 12:15:37.248492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.896517 (+1648025us) service_pool.cc:224] Handling call
0709 12:15:38.912780 (+ 16263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.977175 (+ 64395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.977232 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.981196 (+  3964us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.985937 (+  4741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.986027 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.986147 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:38.917455  8298 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:38.916846  9117 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.992244  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 244) took 1372 ms. Trace:
I20260709 12:15:39.043798  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:39.044174  8369 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.044504  9022 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.044697  8257 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.045493  9174 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.045933  9174 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.046289  9174 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.047196  8993 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.047636  8993 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.048010  8993 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.048252  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.049419  8480 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.049419  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.051381  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.054558  8527 tablet_bootstrap.cc:654] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.055204  9121 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:39.056509  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 68702us
I20260709 12:15:39.057149  8526 tablet_bootstrap.cc:654] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.058372  8297 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.058939  9174 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:39.060292  8445 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:39.061546  8445 leader_election.cc:343] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.040226  8323 rpcz_store.cc:276] 0709 12:15:37.619422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.952683 (+1333261us) service_pool.cc:224] Handling call
0709 12:15:38.991424 (+ 38741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:38.991841 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.991869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:38.991944 (+    75us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.992006 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.992072 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.992185 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:39.042773  8474 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.071316  8472 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:39.072269  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.073074  8477 raft_consensus.cc:2376] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3. Re-sending same reply.
I20260709 12:15:39.076381  9031 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:38.739148  8329 rpcz_store.cc:276] 0709 12:15:36.827052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.003606 (+1176554us) service_pool.cc:224] Handling call
0709 12:15:38.036253 (+ 32647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:38.333972 (+297719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:38.336920 (+  2948us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:38.359164 (+ 22244us) log.cc:844] Serialized 26 byte log entry
0709 12:15:38.492192 (+133028us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:38.497070 (+  4878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:38.502677 (+  5607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:38.635535 (+132858us) raft_consensus.cc:1685] finished
0709 12:15:38.635602 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:38.636024 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3943,"raft.queue_time_us":85229,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":39196,"thread_start_us":308952,"threads_started":2,"wal-append.queue_time_us":144119}
I20260709 12:15:39.078029  9087 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.080386  9087 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.080535  8471 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:39.084095  8220 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.085693  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.088344  8480 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:39.090232  9134 consensus_meta.cc:287] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.002s
W20260709 12:15:39.097224  9109 consensus_meta.cc:287] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.002s
I20260709 12:15:39.099272  9093 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.101864  8446 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.103437  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.087198  9133 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.031949  8954 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:39.037227  8974 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:39.111002  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 212920us
I20260709 12:15:38.917785  8324 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:39.112864  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.111670  9093 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.128350  9148 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.128958  8446 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:39.129711  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:39.129878  9146 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.131771  9133 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.132404  8325 raft_consensus.cc:2393] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:39.135294  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 604151us
I20260709 12:15:39.136610  9152 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:39.140247  8970 consensus_meta.cc:287] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.009s
I20260709 12:15:39.142372  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.144603  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:39.152383  8892 consensus_meta.cc:287] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.011s
I20260709 12:15:39.113296  9134 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.156562  9121 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.157476  9022 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:39.160066  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:38.988533  8250 rpcz_store.cc:269] 0709 12:15:36.908361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.151353 (+242992us) service_pool.cc:224] Handling call
0709 12:15:38.622393 (+1471040us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:38.875822 (+253429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5310720}
I20260709 12:15:39.119771  8956 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.167205  9093 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.125286  8475 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.188241  8400 raft_consensus.cc:2393] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:39.188556  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.189394  8406 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.154163  8328 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:39.195909  8970 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.243275  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.244451  9171 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:39.245010  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.245436  9171 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.245985  8328 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:39.166419  9148 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.247304  9148 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:39.247359  9140 consensus_meta.cc:287] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.006s
I20260709 12:15:39.191421  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.249519  8404 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:39.250938  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.251852  8404 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:39.197614  9121 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.253057  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.256678  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:39.256835  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.204090  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 156) took 1297 ms. Trace:
I20260709 12:15:39.259169  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.220132  9152 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:39.260905  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.191879  9124 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.261713  9124 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.262192  9124 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.116047  9109 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.199215  8330 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.198781  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.166118  8954 raft_consensus.cc:697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:39.220422  8298 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.200953  8329 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:39.263993  8327 raft_consensus.cc:2393] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:39.184899  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.262388  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.203605  8892 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:39.270017  8954 consensus_queue.cc:237] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:39.271687  8892 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.227810  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.231407  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.272658  8401 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.272950  8397 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:39.273183  8479 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.273773  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.274047  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.274534  8401 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:39.274816  8397 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:39.275921  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.276373  8445 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.276636  8397 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:39.277617  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.277732  8892 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:39.232650  8402 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.278163  9118 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:39.279151  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 220949us
I20260709 12:15:39.279994  8297 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.280776  9133 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.281491  9133 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.281661  8297 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.281912  9133 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.282347  9133 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.264910  9109 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.267858  9096 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:39.284257  9096 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:39.267861  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 96960.2us
I20260709 12:15:39.286067  8298 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:39.233759  9116 consensus_meta.cc:287] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.892s	user 0.014s	sys 0.000s
I20260709 12:15:39.234076  8405 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.234190  8476 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:39.235061  8399 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:39.235456  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 48407.2us
I20260709 12:15:39.237167  9134 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.248062  9140 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.269016  8323 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.214843  8956 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.257901  8403 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:39.267540  8477 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.258387  8471 rpcz_store.cc:276] 0709 12:15:37.899038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.904951 (+  5913us) service_pool.cc:224] Handling call
0709 12:15:38.663675 (+758724us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:39.183464 (+519789us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54008c9454. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:39.192811 (+  9347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787043968}
W20260709 12:15:39.335418  8445 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.254729  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.267676  8326 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:39.278158  8892 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.230780  8474 raft_consensus.cc:2468] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:39.288862  9108 consensus_meta.cc:287] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 1.066s	user 0.010s	sys 0.009s
I20260709 12:15:39.297554  9121 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.290558  8473 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:39.296965  9174 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.266734  8478 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.355671  8973 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.290194  9022 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.349457  8220 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.289986  9146 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:39.356505  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 74943.5us
W20260709 12:15:39.355991  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 227176us
W20260709 12:15:39.363407  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 53256us
W20260709 12:15:39.363489  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 77523.5us
I20260709 12:15:39.353926  8956 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.371142  8397 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.356065  8970 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.371948  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:39.286624  8370 connection.cc:256] RPC call timeout handler was delayed by -1.1159151540000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 12:15:39.370693  8892 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:39.356174  9109 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.341358  9116 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:39.396373  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 92663.3us
I20260709 12:15:39.378209  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.394739  8328 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:39.409360  9014 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.397931  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.412468  8298 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:39.393509  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 761477us
W20260709 12:15:39.424376  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 67646.3us
I20260709 12:15:39.403044  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.430079  8297 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.393301  8404 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:39.405544  9107 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.439291  8445 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.440059  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.409402  9092 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.440505  8330 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:39.415447  8475 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.387163  9108 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.406736  8973 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.413791  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 205) took 1037 ms. Trace:
I20260709 12:15:39.450680  9022 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:39.459306  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 61477.9us
W20260709 12:15:39.459582  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 46328.3us
I20260709 12:15:39.439352  8476 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:39.482709  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 70389.1us
I20260709 12:15:39.484664  9123 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.485250  9123 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.486538  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.451969  9107 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.488220  9116 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.490015  9107 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.480784  9118 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:39.491200  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 79606us
I20260709 12:15:39.491634  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.492060  8220 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.493569  8220 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.494319  9022 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:39.494804  9022 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.495317  9022 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:39.495543  9183 log.cc:927] Time spent T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:15:39.496819  9180 log.cc:927] Time spent T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:15:39.498517  9118 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.447855  8403 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:39.499116  9118 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.499639  9118 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.452069  9157 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:39.500622  9157 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.448382  8964 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:39.503686  8964 raft_consensus.cc:697] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:39.504856  8964 consensus_queue.cc:237] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.448016  9133 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.511353  8257 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.512410  9191 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:39.490203  8973 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.494611  9109 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.515169  9109 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.515619  9109 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.518829  8297 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.523203  8993 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.524850  8527 tablet_bootstrap.cc:492] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:39.525384  8527 ts_tablet_manager.cc:1403] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.692s	user 0.017s	sys 0.018s
I20260709 12:15:39.525579  8993 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.539022  9108 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:39.540745  9178 log.cc:927] Time spent T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:15:39.541718  8400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54482 (request call id 114) took 1207 ms. Trace:
I20260709 12:15:39.544044  9171 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.545964  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.458954  8325 rpcz_store.cc:276] 0709 12:15:38.368417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.757387 (+388970us) service_pool.cc:224] Handling call
0709 12:15:39.393812 (+636425us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54008458d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:39.405524 (+ 11712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823659904}
W20260709 12:15:39.548055  9185 log.cc:927] Time spent T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:15:39.548943  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 103558us
I20260709 12:15:39.549275  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 207) took 1155 ms. Trace:
I20260709 12:15:39.549829  8331 rpcz_store.cc:276] 0709 12:15:38.394231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:39.031397 (+637166us) service_pool.cc:224] Handling call
0709 12:15:39.031788 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:39.036144 (+  4356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:39.036188 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:39.109522 (+ 73334us) log.cc:844] Serialized 26 byte log entry
0709 12:15:39.340856 (+231334us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:39.340901 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:39.340966 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:39.548993 (+208027us) raft_consensus.cc:1685] finished
0709 12:15:39.549015 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:39.549189 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49116,"raft.queue_time_us":2464,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":38535,"thread_start_us":223419,"threads_started":1,"wal-append.queue_time_us":293369}
I20260709 12:15:39.551407  9140 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.556226  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.453238  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:39.494415  8404 raft_consensus.cc:1275] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.510797  9133 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.473829  8221 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:39.512573  8445 leader_election.cc:343] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.567981  8445 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.557945  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.499150  9129 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.564296  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.542348  8400 rpcz_store.cc:276] 0709 12:15:38.334339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.338783 (+  4444us) service_pool.cc:224] Handling call
0709 12:15:38.831611 (+492828us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:39.541328 (+709717us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540001b654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:39.541590 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494403712}
I20260709 12:15:39.564941  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.494438  8220 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.565183  8403 raft_consensus.cc:1240] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:39.502754  9157 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.576431  8478 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.577616  8248 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:39.579324  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.593508  8405 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:39.579461  9096 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.580433  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 199) took 1256 ms. Trace:
I20260709 12:15:39.581050  8399 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:39.575258  9108 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.581415  9129 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.581310  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.582237  8326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 209) took 1175 ms. Trace:
I20260709 12:15:39.582736  8398 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:39.582805  9152 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:39.615958  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 103483us
I20260709 12:15:39.616976  8445 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:39.568823  9117 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.588984  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.565809  9148 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:39.595953  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 101574us
I20260709 12:15:39.597201  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:39.597383  8296 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.565404  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.582743  9123 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.570544  8323 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:39.602840  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 84205.2us
W20260709 12:15:39.606838  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 163913us
I20260709 12:15:39.601068  9110 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:39.610165  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:39.607941  9129 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.612807  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:39.614367  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:39.583475  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 111167us
W20260709 12:15:39.557405  9156 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.115s	user 0.001s	sys 0.004s
I20260709 12:15:39.600342  8974 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.593844  8472 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.613744  9157 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:39.629034  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:39.629662  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.611171  9096 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.594640  8473 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:39.674281  9096 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.674342  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.673135  8221 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:39.676661  8297 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.676743  8296 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:39.676031  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 59150.3us
I20260709 12:15:39.655138  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.623041  9087 raft_consensus.cc:2749] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.661290  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:39.661790  8986 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.661525  8527 raft_consensus.cc:359] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.664407  8249 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:39.664876  8257 raft_consensus.cc:1240] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:39.693907  8527 raft_consensus.cc:385] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.696398  8527 raft_consensus.cc:740] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.696456  8222 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.697638  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.698343  8403 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.665141  9124 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.608542  9108 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.699270  9108 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.700224  9148 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:39.652077  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 70864.6us
I20260709 12:15:39.625159  8970 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:15:39.668849  8372 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.619416  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.729069  8974 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.729563  8404 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:39.730845  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:39.731637  8406 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:39.706563  9116 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.733836  8475 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.734301  9116 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.735380  9124 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.675321  9190 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.643740  9129 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.601066  8327 rpcz_store.cc:276] 0709 12:15:38.323966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.743420 (+419454us) service_pool.cc:224] Handling call
0709 12:15:39.580170 (+836750us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54008719d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:39.580356 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519195904}
I20260709 12:15:39.650425  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.677000  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:39.621958  8478 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:39.675930  8405 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.674913  9096 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.647812  9110 raft_consensus.cc:697] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:39.679075  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:39.680958  8328 raft_consensus.cc:1275] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:39.682417  8526 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:39.757288  8331 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:39.757969  8526 ts_tablet_manager.cc:1403] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 1.099s	user 0.018s	sys 0.014s
I20260709 12:15:39.682561  8399 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:39.672143  8474 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.655819  8401 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.683395  8248 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.684370  9117 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.685101  9109 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.633229  8993 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:15:39.662868  8370 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.690194  8296 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.687951  8397 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:39.610167  8326 rpcz_store.cc:276] 0709 12:15:38.406889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.734802 (+327913us) service_pool.cc:224] Handling call
0709 12:15:39.581998 (+847196us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400555354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:39.582165 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625675648}
I20260709 12:15:39.676208  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:39.692286  9123 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.695155  9112 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:39.697386  8527 consensus_queue.cc:260] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.622815  9133 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.727564  8986 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:39.728350  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 59627.5us
I20260709 12:15:39.626575  9107 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:15:39.738139  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 65109.9us
I20260709 12:15:39.661540  9121 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.756940  8297 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.738973  9157 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.746492  9152 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.750535  8892 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:39.739432  9190 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:39.778478  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 88430.7us
I20260709 12:15:39.792601  8298 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.793493  8298 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.794600  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:39.795176  9134 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.795518  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:39.785475  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 106490us
I20260709 12:15:39.782716  9014 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:39.799631  8526 raft_consensus.cc:359] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:39.783118  9093 consensus_meta.cc:287] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
W20260709 12:15:39.761441  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 65182.7us
I20260709 12:15:39.814162  8296 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.815821  8526 raft_consensus.cc:385] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.796491  9161 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.780150  9124 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.794687  8298 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:39.740603  9022 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.816368  8526 raft_consensus.cc:740] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.820804  8332 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:39.786116  9140 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.791302  9152 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:39.795560  9134 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.829613  8526 consensus_queue.cc:260] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.797245  9190 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.815415  9123 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:39.814925  9116 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.827280  8400 raft_consensus.cc:2393] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:39.820190  9014 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.841845  8222 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.839092  8220 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:39.839504  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:39.815011  9107 raft_consensus.cc:697] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:39.820428  9112 raft_consensus.cc:697] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:39.824985  9124 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:39.839846  8956 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.845916  8445 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:39.847236  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 100524us
I20260709 12:15:39.847482  8527 ts_tablet_manager.cc:1434] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.322s	user 0.008s	sys 0.003s
I20260709 12:15:39.847627  9092 consensus_queue.cc:1059] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:39.848132  9123 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.875512  9148 consensus_queue.cc:1048] T cff9ab56f09c438293e24be61ae38fb3 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:39.831887  9025 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:15:39.877369  9148 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.835973  9133 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:39.849692  8986 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.823596  8251 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:39.877835  9148 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.878022  9118 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.879649  8974 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:39.879755  8527 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:39.879844  9113 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.880438  9113 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:39.880882  8974 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.880872  9113 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.883097  8970 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.883572  8970 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:39.883948  8970 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.884147  9148 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.884032  8297 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:39.879765  8526 ts_tablet_manager.cc:1434] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.002s
I20260709 12:15:39.852200  9014 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:39.835994  9152 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.892314  9157 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:39.893656  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 47840.1us
I20260709 12:15:39.895785  8445 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.896585  9087 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.838075  9110 consensus_queue.cc:237] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.897696  9191 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.900364  9191 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:39.900655  9123 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:39.900786  9191 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.901172  9123 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:39.885144  9124 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:39.858165  9195 log.cc:927] Time spent T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:39.851923  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:39.838438  8372 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.831342  9140 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:39.863760  9121 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.864727  9109 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.938110  9014 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.867646  8476 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
W20260709 12:15:39.867761  8222 leader_election.cc:343] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.824303  9093 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:39.939374  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 71681us
I20260709 12:15:39.941152  8222 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:39.941272  9093 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.836097  9134 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.942368  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:39.872821  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52945.9us
I20260709 12:15:39.943780  9148 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.944188  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.946123  9025 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.874069  9107 consensus_queue.cc:237] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:39.947485  8222 consensus_peers.cc:597] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:39.872148  9131 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:39.947692  8993 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.948256  8993 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.948628  8993 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:39.950693  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 66736.3us
I20260709 12:15:39.951169  9131 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.878051  9133 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
W20260709 12:15:39.842684  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 192286us
I20260709 12:15:39.888064  9022 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.901625  8974 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:39.859925  8892 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:39.928318  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:39.897753  9031 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:39.930879  8526 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Bootstrap starting.
I20260709 12:15:39.931173  9205 raft_consensus.cc:3055] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:15:39.931648  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 107614us
I20260709 12:15:39.897048  9087 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.872540  8250 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:39.944314  9148 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:39.856390  8477 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:39.875420  8956 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:39.951574  8297 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:39.871136  9086 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:15:39.956614  8405 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:39.952111  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:39.901654  9123 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:39.952260  8888 raft_consensus.cc:2764] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:15:39.959302  9157 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:39.978543  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 50309.7us
I20260709 12:15:39.993654  9087 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:39.982273  8372 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:39.983060  9129 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.901666  9112 consensus_queue.cc:237] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:39.928256  9108 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:39.976977  9205 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:39.946844  9190 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:39.998435  8527 tablet_bootstrap.cc:654] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:39.993847  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 199224us
I20260709 12:15:39.975171  9199 consensus_queue.cc:1059] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:15:40.027470  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:39.991710  9092 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:40.001150  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 204614us
W20260709 12:15:40.004278  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 52812.3us
I20260709 12:15:40.029322  8297 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.030227  8956 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.030334  9190 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.030455  9152 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.031397  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.032068  8252 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.033223  9152 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:39.992417  9148 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.018862  9118 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.040479  8956 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:40.041736  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.042790  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:40.043208  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 61072.8us
I20260709 12:15:40.050166  8151 catalog_manager.cc:5697] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } }
I20260709 12:15:39.974792  9093 consensus_queue.cc:1059] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:15:39.990751  9191 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.073345  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.073473  8298 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.074306  8405 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:40.061854  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:40.011804  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 59779.5us
I20260709 12:15:40.026087  8993 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.027191  9157 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.008141  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:40.077702  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 69679.2us
I20260709 12:15:40.079622  9190 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:40.080130  9190 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.080374  8254 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:40.080636  9190 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:40.048024  9092 raft_consensus.cc:697] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:40.082500  9092 consensus_queue.cc:237] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.084707  8888 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:40.047469  9199 raft_consensus.cc:3055] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.085754  9199 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:40.087018  9199 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.088882  9199 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.044229  9031 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.089301  9014 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.089565  9031 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.089892  8993 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.048970  8155 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37602 (request call id 75) took 2682 ms. Trace:
I20260709 12:15:39.952747  8323 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:39.994067  8970 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.053316  9133 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.049304  9096 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.045974  9205 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.052752  9108 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.012775  9204 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:40.050453  8397 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:40.047917  8954 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:15:40.062300  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 164861us
I20260709 12:15:40.062767  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.061617  9124 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.072381  9093 raft_consensus.cc:3055] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:15:40.146550  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 227747us
I20260709 12:15:40.044117  9161 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.019131  8401 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:40.094946  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.101265  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.154649  8331 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 4
I20260709 12:15:40.154759  8330 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:40.106675  8973 raft_consensus.cc:2764] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:40.089421  8151 catalog_manager.cc:5697] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 1 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.103127  9025 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:40.103256  9191 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.092607  8222 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:40.072741  8251 raft_consensus.cc:1275] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:40.119827  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 88585.5us
I20260709 12:15:40.129344  8954 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:40.123548  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.180409  8297 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.180987  8405 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.072796  9208 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:40.147048  9093 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:40.141176  8220 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.090888  8155 rpcz_store.cc:276] 0709 12:15:37.381116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:37.384720 (+  3604us) service_pool.cc:224] Handling call
0709 12:15:40.048694 (+2663974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:38.581911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:38.583786 (+  1875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:38.583819 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:15:38.583843 (+    24us) tablet.cc:662] Decoding operations
0709 12:15:38.584550 (+   707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:38.584630 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:38.584657 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:15:38.585008 (+   351us) tablet.cc:701] Row locks acquired
0709 12:15:38.585026 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:38.585173 (+   147us) write_op.cc:270] Start()
0709 12:15:38.585295 (+   122us) write_op.cc:276] Timestamp: P: 1783599338585125 usec, L: 0
0709 12:15:38.585316 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:38.735780 (+150464us) log.cc:844] Serialized 1307 byte log entry
0709 12:15:39.659707 (+923927us) op_driver.cc:464] REPLICATION: finished
0709 12:15:39.931597 (+271890us) write_op.cc:301] APPLY: starting
0709 12:15:39.931708 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:39.931913 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:39.932069 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:39.932779 (+   710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:39.933091 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:15:39.933185 (+    94us) write_op.cc:312] APPLY: finished
0709 12:15:39.933661 (+   476us) log.cc:844] Serialized 34 byte log entry
0709 12:15:39.934727 (+  1066us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:39.934906 (+   179us) write_op.cc:454] Released schema lock
0709 12:15:39.934971 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:39.987220 (+ 52249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:39.987248 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":271579,"apply.run_cpu_time_us":3274,"apply.run_wall_time_us":55630,"num_ops":3,"prepare.queue_time_us":265656,"prepare.run_cpu_time_us":26828,"prepare.run_wall_time_us":420849,"raft.queue_time_us":520963,"raft.run_cpu_time_us":15911,"raft.run_wall_time_us":128046,"replication_time_us":1074170,"thread_start_us":884111,"threads_started":4,"wal-append.queue_time_us":399826}]]}
I20260709 12:15:40.109678  8956 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.107802  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.122316  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.175793  8296 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.120929  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.178154  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.148638  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.129469  8403 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.185235  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.180339  8445 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:40.186431  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 93915us
I20260709 12:15:40.162086  8993 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:40.209901  9124 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.209769  8993 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:40.191956  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.212221  8993 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.212582  9086 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.212730  8964 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.213306  8964 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.213697  9113 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.214622  8954 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.215866  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.216050  8954 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:40.216635  9140 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:40.217108  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.193828  8526 tablet_bootstrap.cc:654] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:40.218643  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.219210  8330 raft_consensus.cc:1240] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:40.196966  9108 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:40.219806  9025 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:40.220417  9025 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.220813  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.222174  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.172531  9161 raft_consensus.cc:697] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:40.224215  9157 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.224630  8324 raft_consensus.cc:1240] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:40.224762  9161 consensus_queue.cc:237] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.225822  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.226617  8324 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.227630  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.197801  8296 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.168015  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.204664  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.196980  8255 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:40.205662  8404 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.191484  9205 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.205943  9107 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:40.206789  9191 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.208033  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.208611  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.209209  9204 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:40.213254  9086 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.168679  8248 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
W20260709 12:15:40.193652  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 52574.9us
I20260709 12:15:40.204911  8956 raft_consensus.cc:697] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:40.185309  8254 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:40.183233  9208 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:40.255717  8405 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:40.186010  8888 consensus_queue.cc:1059] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:15:40.257186  9108 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.257591  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.180230  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:40.249411  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 51682.6us
I20260709 12:15:40.263615  8398 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.266772  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.262502  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.268915  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.274341  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.275312  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.441401  8476 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:40.442164  8404 raft_consensus.cc:2393] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:40.277580  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.444739  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.445468  8325 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.445858  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.270740  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.279217  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.447764  8475 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.448055  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.448776  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.442411  8471 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.449517  8475 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:40.450325  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.280658  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.451807  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.452067  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.282478  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.261474  9148 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.462611  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.208653  9110 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.295830  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.298182  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.309566  8403 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:40.442667  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.312472  8297 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.303231  8323 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.204924  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.305336  9134 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.429361  8443 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.292384  8402 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:40.173277  9213 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:15:40.432736  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.267275  9112 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.307080  8327 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.303076  9107 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:40.281878  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.307530  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.294157  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.297689  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:40.454349  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 167521us
I20260709 12:15:40.450536  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:40.463117  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 147152us
W20260709 12:15:40.250633  9212 log.cc:927] Time spent T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:15:40.464128  8479 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:40.287923  9096 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:40.297032  9129 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.307612  9204 raft_consensus.cc:697] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:40.528820  9112 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.612924  9204 consensus_queue.cc:237] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.615154  9112 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.615352  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.599889  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.616806  8398 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:40.618036  8527 tablet_bootstrap.cc:492] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:40.618602  8527 ts_tablet_manager.cc:1403] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.739s	user 0.051s	sys 0.019s
I20260709 12:15:40.618433  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.620355  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.525949  9107 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:40.623473  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 89461.4us
W20260709 12:15:40.625000  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.462097  8956 consensus_queue.cc:237] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.341013  9208 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.306193  8970 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.631088  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:40.611207  9229 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:15:40.322748  8331 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:40.632489  9086 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:40.602566  9224 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:15:40.633159  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.304970  9123 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.288082  8892 consensus_queue.cc:1048] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.172s
I20260709 12:15:40.431555  9131 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.438597  8973 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.294077  8964 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.477577  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.643901  8403 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:40.645190  8325 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:40.603904  8475 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:40.646268  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.282940  8252 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:40.533632  9116 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:40.434767  9108 raft_consensus.cc:697] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:40.647781  8325 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:40.648394  9108 consensus_queue.cc:237] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.505057  8478 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:40.474895  8477 raft_consensus.cc:2368] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
W20260709 12:15:40.286011  9217 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:15:40.457149  9140 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.665639  9140 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.666148  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.667353  8327 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.668944  8327 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:40.609275  8472 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:40.601655  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.672232  8406 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:40.610448  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.674806  8328 raft_consensus.cc:2393] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.676239  8328 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:40.678237  9148 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.630661  9025 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.659885  9131 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.681363  9025 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.692879  8327 raft_consensus.cc:1275] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:40.510133  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 197742us
I20260709 12:15:40.697095  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.697706  8297 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:40.505057  9187 log.cc:927] Time spent T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:15:40.433799  9031 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.286656  9093 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.499387  8993 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:40.519726  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 90501us
I20260709 12:15:40.463827  9087 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.507450  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.498744  8329 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:40.694168  9107 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.529651  8332 raft_consensus.cc:2393] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.512300  9109 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:40.522914  8476 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.516093  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:40.597775  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:40.519338  9157 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.306490  9191 raft_consensus.cc:697] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:40.783998  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 58326.4us
I20260709 12:15:40.784231  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.784724  9191 consensus_queue.cc:237] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.785145  8370 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:40.641691  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:40.642439  8397 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 0.
I20260709 12:15:40.642659  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.642581  8973 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:40.651237  8526 tablet_bootstrap.cc:492] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: No bootstrap required, opened a new log
I20260709 12:15:40.658275  8527 raft_consensus.cc:359] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.792266  8527 raft_consensus.cc:385] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.611361  8473 raft_consensus.cc:2393] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.792455  8526 ts_tablet_manager.cc:1403] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Time spent bootstrapping tablet: real 0.862s	user 0.063s	sys 0.097s
I20260709 12:15:40.792567  8527 raft_consensus.cc:740] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
W20260709 12:15:40.611059  9190 consensus_meta.cc:287] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.003s
I20260709 12:15:40.659960  8479 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:40.639990  9113 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.794497  8527 consensus_queue.cc:260] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.699712  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.803339  8472 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.803833  8220 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.700749  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:40.807312  8399 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.510010  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.811926  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.812551  9190 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.813051  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.708765  8297 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:40.815409  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 106746us
I20260709 12:15:40.707576  8251 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:40.714357  9129 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.741479  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.736953  9208 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.739342  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:40.740114  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.740339  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.725114  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.715327  9140 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.783804  9157 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:40.303700  8151 catalog_manager.cc:5697] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 2, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } }
I20260709 12:15:40.725637  8325 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:40.698675  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:40.795080  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 153472us
I20260709 12:15:40.798309  8402 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.838776  9113 raft_consensus.cc:2749] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:40.887013  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.888374  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.887651  8151 catalog_manager.cc:5697] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
I20260709 12:15:40.889544  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.891495  8399 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:40.891935  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.893008  8399 raft_consensus.cc:1275] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:40.893501  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:40.734418  8993 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:40.798933  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:40.799654  9232 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:40.802575  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.734233  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.890682  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:40.926837  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 195812us
I20260709 12:15:40.850800  8220 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:40.892009  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.880239  8330 raft_consensus.cc:1240] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:40.784026  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.885912  8443 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.853113  8480 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:40.807271  8986 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:40.830209  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.949546  8480 raft_consensus.cc:1240] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:40.894567  8325 raft_consensus.cc:2393] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:40.726305  9110 raft_consensus.cc:697] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:40.896077  8324 raft_consensus.cc:2368] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:40.935122  8446 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:40.964432  8993 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:40.992089  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 65351.9us
W20260709 12:15:40.993597  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 107806us
I20260709 12:15:40.852545  8526 raft_consensus.cc:359] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:40.994554  8526 raft_consensus.cc:385] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:40.995097  8526 raft_consensus.cc:740] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Initialized, Role: FOLLOWER
I20260709 12:15:40.881953  8328 raft_consensus.cc:2368] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:40.815044  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.999349  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.000025  8526 consensus_queue.cc:260] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.000983  8443 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:41.001722  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:40.889966  8151 catalog_manager.cc:5697] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
I20260709 12:15:40.815304  8254 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:40.952698  9235 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:15:40.951171  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 100494us
I20260709 12:15:41.012924  8220 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:40.953064  9228 log.cc:927] Time spent T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:15:40.953299  9031 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.955214  9131 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.956494  8248 raft_consensus.cc:2393] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.941768  8473 raft_consensus.cc:2376] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1. Re-sending same reply.
I20260709 12:15:40.846892  9133 consensus_queue.cc:1048] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.120s
I20260709 12:15:41.032501  8220 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:40.895685  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:40.960529  9092 raft_consensus.cc:3055] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.947348  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:40.958747  8472 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:40.962369  9123 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:40.964054  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.964335  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:40.881490  9208 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:40.990273  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.060308  8479 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.879067  9161 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:15:41.004132  8256 raft_consensus.cc:2393] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:40.948395  8986 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:41.002333  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 184504us
I20260709 12:15:40.989313  9140 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:40.951385  9190 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:41.010638  8222 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:40.991210  8888 raft_consensus.cc:2764] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:15:40.998186  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:41.022953  8298 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.026257  8973 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:40.965001  9232 raft_consensus.cc:697] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.044725  8954 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.029995  8480 raft_consensus.cc:1240] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:40.847177  8974 consensus_queue.cc:1059] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:15:41.000160  9085 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:41.039974  8445 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.043509  8526 ts_tablet_manager.cc:1434] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Time spent starting tablet: real 0.250s	user 0.012s	sys 0.003s
I20260709 12:15:41.032882  8993 consensus_queue.cc:1059] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:41.022918  9025 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:41.060716  8330 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:41.022431  9213 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:41.064265  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:41.069327  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 58749.6us
I20260709 12:15:41.070648  8477 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:41.086794  8222 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:41.033243  9235 raft_consensus.cc:697] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.045259  9148 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.044188  8474 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:41.058574  8404 raft_consensus.cc:3055] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:41.029037  8964 consensus_queue.cc:1048] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:15:41.005765  8255 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.042783  9092 raft_consensus.cc:740] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.081185  9087 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:41.047482  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 262382us
I20260709 12:15:41.079689  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.066113  8986 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.115691  8445 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.117476  8954 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.118172  8954 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:15:41.118561  9240 log.cc:927] Time spent T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:41.118770  8954 consensus_queue.cc:1048] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.089781  9025 raft_consensus.cc:697] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.121932  9025 consensus_queue.cc:237] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.065212  9140 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:41.123201  9140 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.125278  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.126588  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.063916  8297 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:41.058054  9031 consensus_queue.cc:1059] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:15:41.042399  9116 consensus_queue.cc:1059] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:15:41.080507  8327 raft_consensus.cc:2368] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
W20260709 12:15:41.092797  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 69965.4us
I20260709 12:15:41.098387  8222 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.098500  8443 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.080798  9190 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.059185  9129 raft_consensus.cc:697] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:41.091387  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.098230  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.076273  8372 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.100306  9022 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:41.100805  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.089861  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:41.100980  9107 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.085778  9085 raft_consensus.cc:697] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.100808  9092 consensus_queue.cc:260] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.105026  8326 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:41.106271  9235 consensus_queue.cc:237] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.090469  9213 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.094517  9148 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:41.109318  9123 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.097266  8404 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:41.111414  9093 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.076324  9161 consensus_queue.cc:1243] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 70ae764f2abd44229023295f5cc6bf37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:41.059899  8476 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:41.128249  8993 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.128949  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.192271  8986 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.193764  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.194593  8986 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:41.194954  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.195639  8255 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:41.196846  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.198241  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.060165  9110 consensus_queue.cc:237] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.129755  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.131035  9232 consensus_queue.cc:237] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:41.132777  8445 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:41.202886  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 70140.5us
I20260709 12:15:41.200215  8251 raft_consensus.cc:2393] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.134140  8370 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.144436  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:41.153019  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 54708us
I20260709 12:15:41.207562  8406 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.207384  8221 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.208855  8221 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:41.209457  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 75380.9us
W20260709 12:15:41.170583  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 77622.7us
I20260709 12:15:41.162971  9248 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:41.167956  9014 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:41.167711  9204 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.178517  8323 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:41.219974  9118 consensus_queue.cc:1059] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.220422  8404 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.221069  9118 raft_consensus.cc:3055] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.221421  9118 raft_consensus.cc:740] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.223399  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.223999  8405 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.224671  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:41.225306  8329 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.226692  8443 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.225307  9161 raft_consensus.cc:2749] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.227931  8443 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.228024  9096 raft_consensus.cc:3055] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.228492  9096 raft_consensus.cc:740] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.229380  9096 consensus_queue.cc:260] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.230118  8323 raft_consensus.cc:1275] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:41.174152  9244 consensus_queue.cc:1048] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:15:41.192031  8993 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.231189  9248 raft_consensus.cc:697] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:41.231334  9213 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:41.232229  9248 consensus_queue.cc:237] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.232795  8993 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.179066  9022 raft_consensus.cc:697] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.233078  8327 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:41.211683  9204 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.233958  9022 consensus_queue.cc:237] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.234575  9204 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.236166  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.183152  9148 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:41.141119  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 77274.1us
I20260709 12:15:41.210215  8370 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.213217  9241 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:41.213999  9242 log.cc:927] Time spent T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:15:41.213270  9014 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.215314  8986 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.217569  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.218088  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.219381  8974 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:41.219497  9140 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.221458  8404 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.168524  9205 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:41.201488  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 139188us
I20260709 12:15:41.206610  8325 raft_consensus.cc:1240] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.243781  8221 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:41.243989  8443 consensus_peers.cc:597] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c -> Peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Couldn't send request to peer 70ae764f2abd44229023295f5cc6bf37. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:41.247462  8298 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.248404  8405 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:41.230744  9096 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.222404  9118 consensus_queue.cc:260] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.252992  8406 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:41.347705  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.241146  9113 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:41.258594  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 130746us
I20260709 12:15:41.246529  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:41.353394  8255 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:41.243099  8892 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.192066  9129 consensus_queue.cc:237] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.273595  8256 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:41.273639  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 63496.9us
I20260709 12:15:41.249342  9087 raft_consensus.cc:2749] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.277853  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.241736  9116 consensus_queue.cc:1059] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:41.279614  9025 raft_consensus.cc:2804] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.251189  9124 consensus_queue.cc:1059] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:15:41.256441  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:41.282521  9104 raft_consensus.cc:3055] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:41.283087  8221 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.283425  8480 raft_consensus.cc:1275] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:41.283869  9244 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.251379  9131 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:15:41.344931  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:41.286387  8527 ts_tablet_manager.cc:1434] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.667s	user 0.019s	sys 0.012s
I20260709 12:15:41.286305  9014 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.286886  8251 raft_consensus.cc:1240] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.275424  8974 raft_consensus.cc:697] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.290155  9239 raft_consensus.cc:3055] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:41.297633  8446 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:41.409540  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 112003us
I20260709 12:15:41.300773  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 278) took 1201 ms. Trace:
I20260709 12:15:41.307646  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.315794  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 151) took 1184 ms. Trace:
I20260709 12:15:41.316550  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 88) took 1109 ms. Trace:
I20260709 12:15:41.413793  8478 rpcz_store.cc:276] 0709 12:15:40.206972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.217201 (+ 10229us) service_pool.cc:224] Handling call
0709 12:15:40.270578 (+ 53377us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:41.316372 (+1045794us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54006a2f54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:41.316487 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159025152}
I20260709 12:15:41.322340  9134 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:41.324112  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:41.325771  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:41.325088  9236 log.cc:927] Time spent T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.596s	user 0.005s	sys 0.000s
I20260709 12:15:41.326249  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:41.422850  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:41.378018  8399 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:41.423532  9157 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:41.424911  8324 raft_consensus.cc:1240] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.426468  8324 raft_consensus.cc:1240] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.428143  8403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 300) took 1224 ms. Trace:
I20260709 12:15:41.428597  8403 rpcz_store.cc:276] 0709 12:15:40.203920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.645623 (+441703us) service_pool.cc:224] Handling call
0709 12:15:40.645920 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:40.646314 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:40.646342 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:40.646821 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:15:40.727927 (+ 81106us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:40.727969 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:40.728040 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:41.324217 (+596177us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:41.427844 (+103627us) raft_consensus.cc:1685] finished
0709 12:15:41.427868 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:41.428081 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1319,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":8585088,"thread_start_us":77207,"threads_started":1,"wal-append.queue_time_us":81156}
I20260709 12:15:41.429787  8324 raft_consensus.cc:1240] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.326927  8323 raft_consensus.cc:1275] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:41.251441  8993 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.327509  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:41.431885  9093 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.417279  8249 rpcz_store.cc:276] 0709 12:15:40.131860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.204635 (+ 72775us) service_pool.cc:224] Handling call
0709 12:15:41.315508 (+1110873us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540026b954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:41.315709 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254653184}
I20260709 12:15:41.432600  9093 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.433627  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.423256  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.328058  8475 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:41.329280  9140 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:41.329407  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:41.435515  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.423192  9249 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:15:41.436617  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.408870  9239 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:41.438081  9134 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:41.333397  8372 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.341058  9245 raft_consensus.cc:3055] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.342237  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:41.343289  9222 log.cc:927] Time spent T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:15:41.215310  9085 consensus_queue.cc:237] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.344805  8402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 139) took 1277 ms. Trace:
I20260709 12:15:41.408563  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.358144  9161 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.358769  8369 leader_election.cc:400] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
W20260709 12:15:41.371417  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 88465.7us
I20260709 12:15:41.417663  9124 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.376722  8297 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.410312  8332 rpcz_store.cc:276] 0709 12:15:40.098928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.099251 (+   323us) service_pool.cc:224] Handling call
0709 12:15:41.300570 (+1201319us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b5400226854. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:41.300708 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753930240}
W20260709 12:15:41.376431  8527 ts_tablet_manager.cc:1467] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Tablet startup took 757ms
I20260709 12:15:41.411899  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:41.418378  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 56621.1us
W20260709 12:15:41.453002  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 76376.7us
I20260709 12:15:41.453727  8405 raft_consensus.cc:2393] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.375559  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 208) took 1030 ms. Trace:
I20260709 12:15:41.420480  9022 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.460955  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:41.420665  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 94998.2us
I20260709 12:15:41.375607  9113 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.434579  8249 raft_consensus.cc:2393] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.378010  9190 raft_consensus.cc:3055] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:41.468446  9190 raft_consensus.cc:740] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.469408  9190 consensus_queue.cc:260] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.470631  9190 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.435520  8403 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:41.375571  9025 raft_consensus.cc:697] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.471028  9113 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.472113  9025 consensus_queue.cc:237] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.426682  8399 raft_consensus.cc:1240] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.474776  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.377486  9235 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.370671  9104 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.407441  8892 raft_consensus.cc:3055] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:41.476274  8892 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:41.476660  9104 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.477226  8892 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.477950  9104 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.478587  8892 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.478963  9093 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.480376  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.481173  8478 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:41.481973  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.445148  8480 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:41.348820  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:41.484313  8406 raft_consensus.cc:2393] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.438745  9134 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:41.373361  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:41.451038  8369 leader_election.cc:403] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:15:41.447060  8402 rpcz_store.cc:276] 0709 12:15:40.067792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.627199 (+559407us) service_pool.cc:224] Handling call
0709 12:15:40.794478 (+167279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.109576 (+315098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.344555 (+234979us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540001cf50. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:41.344736 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377944960}
I20260709 12:15:41.456496  9014 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.490073  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 131534us
I20260709 12:15:41.490830  8369 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.452349  9124 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.442421  9245 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:41.461338  9161 consensus_queue.cc:1243] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 70ae764f2abd44229023295f5cc6bf37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:41.464819  8221 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:41.466082  8370 leader_election.cc:400] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:41.467536  8405 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.502063  8370 leader_election.cc:403] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:41.484537  8480 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:41.485368  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:41.458688  8974 consensus_queue.cc:237] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.462626  8222 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:41.449854  8329 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:41.456259  9140 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.495632  8443 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.470737  9229 raft_consensus.cc:3055] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:41.507180  8478 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:41.494414  8964 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:41.502928  9267 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:41.452811  8527 ts_tablet_manager.cc:1469] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Trace:
0709 12:15:23.768306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.768480 (+   174us) service_pool.cc:224] Handling call
0709 12:15:23.770110 (+  1630us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:15:23.770209 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:15:23.837345 (+ 67136us) tablet_metadata.cc:665] Metadata flushed
0709 12:15:23.986257 (+148912us) tablet_replica.cc:206] Creating consensus instance
0709 12:15:23.986650 (+   393us) inbound_call.cc:177] Queueing success response
0709 12:15:39.879351 (+15892701us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:15:40.618923 (+739572us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:15:40.619676 (+   753us) tablet_replica.cc:261] Starting instrumentation
0709 12:15:40.620256 (+   580us) tablet_replica.cc:280] Starting consensus
0709 12:15:41.285378 (+665122us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b18002d0ee0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0e2d71 00007f1251adfb2e
Metrics: {"raft.queue_time_us":179811,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11048,"spinlock_wait_cycles":17324928,"tablet-open.queue_time_us":15892733,"thread_start_us":162196,"threads_started":1}
W20260709 12:15:41.484556  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 133642us
W20260709 12:15:41.564920  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 58150.9us
W20260709 12:15:41.570885  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 66033.6us
I20260709 12:15:41.465802  9131 consensus_queue.cc:1059] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:15:41.497203  8993 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
W20260709 12:15:41.572402  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 109831us
I20260709 12:15:41.463932  9110 consensus_queue.cc:1059] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:15:41.438184  9239 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:41.599280  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 103762us
I20260709 12:15:41.600255  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:41.571446  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 79221.7us
I20260709 12:15:41.578116  8986 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:41.578368  9245 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.579312  8372 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.580423  8527 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:41.581189  8248 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.583250  8331 raft_consensus.cc:1240] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.458060  8397 rpcz_store.cc:276] 0709 12:15:40.342265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.800527 (+458262us) service_pool.cc:224] Handling call
0709 12:15:40.800848 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:40.801079 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:40.801107 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:40.801612 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.024217 (+222605us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:41.255889 (+231672us) log.cc:844] Serialized 14 byte log entry
0709 12:15:41.279096 (+ 23207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.350196 (+ 71100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:41.361659 (+ 11463us) raft_consensus.cc:1685] finished
0709 12:15:41.361683 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:41.372976 (+ 11293us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76167,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":115,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":46502,"thread_start_us":370533,"threads_started":2,"wal-append.queue_time_us":276766}
I20260709 12:15:41.585704  8398 raft_consensus.cc:1275] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:41.586737  8297 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:41.587510  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 133886us
W20260709 12:15:41.660327  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 73579.2us
I20260709 12:15:41.662650  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.604897  9205 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.575476  9235 consensus_queue.cc:1048] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.058s
I20260709 12:15:41.573482  8296 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:41.592218  8222 leader_election.cc:343] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.511324  9022 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:41.596765  8480 raft_consensus.cc:1240] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.601856  8369 leader_election.cc:400] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:41.631795  8257 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:41.606345  8478 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:41.484807  9232 consensus_queue.cc:1059] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.082s
I20260709 12:15:41.493599  9087 consensus_queue.cc:1059] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:15:41.565356  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.571892  9014 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.572589  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:41.625293  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 49357.9us
I20260709 12:15:41.581037  9271 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:41.512836  8400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 205) took 1198 ms. Trace:
I20260709 12:15:41.674616  9248 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.574335  9229 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:41.629665  9259 log.cc:927] Time spent T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:15:41.586458  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.511373  9157 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:15:41.592151  8964 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.766669  8474 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:41.499591  9124 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.667948  8370 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:41.670959  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 78776us
I20260709 12:15:41.507287  9204 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.623433  9112 consensus_queue.cc:1059] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:15:41.672400  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 98995.4us
I20260709 12:15:41.672943  8369 leader_election.cc:403] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:15:41.603632  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.658627  8993 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:41.502857  9116 consensus_queue.cc:1059] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 12:15:41.696492  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:41.687887  9148 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:41.672287  9022 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.671872  8986 raft_consensus.cc:697] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.699402  8251 raft_consensus.cc:2393] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.691658  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:41.827592  8480 raft_consensus.cc:2393] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:41.677974  9025 raft_consensus.cc:3055] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:15:41.675873  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 96671.8us
I20260709 12:15:41.665709  9244 consensus_queue.cc:1048] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:15:41.680320  9245 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.674968  9121 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:41.680811  9241 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:41.693678  9014 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.766413  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:41.575999  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:41.755664  8255 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:41.817588  9271 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:41.775454  8222 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:41.800478  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 139918us
W20260709 12:15:41.817085  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:41.817842  8478 raft_consensus.cc:2393] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:41.819422  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 217741us
W20260709 12:15:41.768323  9263 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 12:15:41.770766  9264 log.cc:927] Time spent T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:15:41.766848  9272 consensus_queue.cc:1059] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:15:41.828608  9140 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:41.865549  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.798903  8397 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:41.681000  9239 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:41.829282  9022 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.907925  8249 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
W20260709 12:15:41.917688  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52270.5us
I20260709 12:15:41.905128  8370 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:41.907554  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 132235us
I20260709 12:15:41.918943  8296 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.903880  8446 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:41.832409  9025 raft_consensus.cc:740] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.868887  9110 raft_consensus.cc:3055] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:41.860543  9134 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:41.866914  9206 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:41.903288  8253 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.918733  8254 raft_consensus.cc:2368] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:41.878397  8956 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:41.938457  9134 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:41.939528  8472 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:41.934998  9110 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:41.935410  9231 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:41.908985  9116 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.941278  9014 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:41.930190  9113 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:15:41.948105  8222 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:41.952562  8371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:41.991770  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 86773.3us
I20260709 12:15:41.993139  8370 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:41.913842  9161 consensus_queue.cc:1059] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:15:41.848541  9229 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:41.929919  9271 raft_consensus.cc:697] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:41.947908  9241 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:41.938539  9025 consensus_queue.cc:260] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:41.944417  9121 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:41.931524  8399 raft_consensus.cc:1240] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:41.695844  8400 rpcz_store.cc:276] 0709 12:15:40.310883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.739590 (+428707us) service_pool.cc:224] Handling call
0709 12:15:40.740062 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.078787 (+338725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.082194 (+  3407us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.109549 (+ 27355us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.279135 (+169586us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:41.346367 (+ 67232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.355149 (+  8782us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:41.481730 (+126581us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54000d9e20. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e062dbe 00007f124e06d930 00007f124e06d8d8 00007f124e06d858 00007f124e06d813 00007f124e06ca9c 00007f1253f582f6 00007f1253f52aa8 00007f124e0a97cb 00007f124e0ac2c0
0709 12:15:41.486449 (+  4719us) raft_consensus.cc:1685] finished
0709 12:15:41.487592 (+  1143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:41.508801 (+ 21209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168740,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":14432,"spinlock_wait_cycles":112471424,"thread_start_us":482661,"threads_started":2,"wal-append.queue_time_us":158170}
I20260709 12:15:41.962752  9096 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:42.011405  8986 consensus_queue.cc:237] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.013684  8401 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.017637  9092 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.011664  8372 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:41.964887  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 221955us
I20260709 12:15:42.041672  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:42.047415  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 128556us
I20260709 12:15:42.048529  8296 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.944795  9206 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.054381  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:42.006346  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:41.962968  8956 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.064775  8296 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:42.062577  8332 raft_consensus.cc:2368] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
W20260709 12:15:42.072013  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 99955.2us
I20260709 12:15:41.930387  8964 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.074625  8296 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:41.998013  9116 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.041016  9280 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:42.105917  8296 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:42.049108  9229 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.078709  9272 raft_consensus.cc:3055] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.019311  9121 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.046423  9108 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:42.046550  9096 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.070135  9113 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.080706  9231 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:15:42.127449  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 82967.7us
W20260709 12:15:42.164179  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.080641  9123 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.107371  9244 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.238366  9244 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.239560  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:42.240928  9206 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:42.242107  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 124) took 1441 ms. Trace:
I20260709 12:15:42.242563  8253 rpcz_store.cc:276] 0709 12:15:40.800641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.229349 (+428708us) service_pool.cc:224] Handling call
0709 12:15:41.229675 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.962866 (+733191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.241827 (+278961us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400268254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:42.242035 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455227648}
I20260709 12:15:42.101286  9014 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
W20260709 12:15:42.247609  9287 log.cc:927] Time spent T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:15:42.112082  9280 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:42.080417  9134 consensus_queue.cc:1059] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.147s
I20260709 12:15:42.074236  9129 consensus_queue.cc:1059] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 12:15:42.224790  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:42.106267  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:42.181123  9148 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.248275  9280 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.126500  9204 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.115620  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:42.196254  9272 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:42.229913  8400 raft_consensus.cc:1240] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.266973  8220 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:42.229609  8401 raft_consensus.cc:1275] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.225808  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:42.223289  9108 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.260305  9283 consensus_queue.cc:1048] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:15:42.270351  9134 raft_consensus.cc:3055] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.287770  9134 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:42.288661  9134 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.289994  9134 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.271144  9206 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.284384  8325 raft_consensus.cc:2376] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2. Re-sending same reply.
I20260709 12:15:42.291247  9206 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.292245  9280 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:42.293126  8892 consensus_meta.cc:287] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.006s
I20260709 12:15:42.293454  9206 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:42.294322  9280 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:42.276458  9277 log.cc:927] Time spent T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 12:15:42.280198  8527 tablet_bootstrap.cc:654] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.237534  9123 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.230396  9231 raft_consensus.cc:697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:42.259871  8474 raft_consensus.cc:1275] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:42.275638  9281 log.cc:927] Time spent T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:15:42.110567  9248 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 12:15:42.297220  8956 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.290638  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:42.070947  9110 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.264262  9085 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.314435  8478 raft_consensus.cc:2393] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:42.295095  9113 raft_consensus.cc:697] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:42.307060  9123 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.328552  9191 raft_consensus.cc:3055] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.328972  9096 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:42.329463  9093 raft_consensus.cc:3055] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.329859  9093 raft_consensus.cc:740] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:42.330670  9093 consensus_queue.cc:260] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.334463  8402 raft_consensus.cc:3055] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.334856  8402 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:42.335557  8402 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:42.336103  9104 consensus_meta.cc:287] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.858s	user 0.012s	sys 0.000s
I20260709 12:15:42.336726  8402 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:42.316825  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:42.308743  8404 consensus_meta.cc:287] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 1.030s	user 0.014s	sys 0.000s
I20260709 12:15:42.317003  8298 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:42.297243  8471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 101) took 1999 ms (client timeout 1999 ms). Trace:
W20260709 12:15:42.321368  9190 consensus_meta.cc:287] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.000s
I20260709 12:15:42.322427  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 162) took 1073 ms. Trace:
I20260709 12:15:42.323136  9085 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.386811  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:42.389182  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:42.390302  9085 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:42.385488  8471 rpcz_store.cc:269] 0709 12:15:40.297658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.451499 (+153841us) service_pool.cc:224] Handling call
0709 12:15:42.297039 (+1845540us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54008c9454. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:42.297183 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586513664}
I20260709 12:15:42.386744  8248 rpcz_store.cc:276] 0709 12:15:41.249190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.677494 (+428304us) service_pool.cc:224] Handling call
0709 12:15:41.698901 (+ 21407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.747588 (+ 48687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.764754 (+ 17166us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.765419 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 12:15:42.043820 (+278401us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:42.050465 (+  6645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.078087 (+ 27622us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.322188 (+244101us) raft_consensus.cc:1685] finished
0709 12:15:42.322213 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.322365 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25379,"raft.queue_time_us":75909,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":22159,"thread_start_us":201488,"threads_started":1,"wal-append.queue_time_us":285769}
I20260709 12:15:42.391788  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:42.392453  8471 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:42.393796  8471 raft_consensus.cc:1275] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:42.298015  9204 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.394111  8471 pending_rounds.cc:85] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Aborting all ops after (but not including) 1
I20260709 12:15:42.394553  8471 pending_rounds.cc:107] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:42.394726  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:42.394918  8471 raft_consensus.cc:2889] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:42.395628  8326 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.339443  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 230) took 1088 ms. Trace:
I20260709 12:15:42.396135  8476 rpcz_store.cc:276] 0709 12:15:41.250801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.251218 (+   417us) service_pool.cc:224] Handling call
0709 12:15:41.666796 (+415578us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:41.675498 (+  8702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.691229 (+ 15731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.697804 (+  6575us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.698327 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.935451 (+237124us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:41.946484 (+ 11033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:41.963506 (+ 17022us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.339084 (+375578us) raft_consensus.cc:1685] finished
0709 12:15:42.339105 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.339346 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44267904,"thread_start_us":225562,"threads_started":1,"wal-append.queue_time_us":312005}
I20260709 12:15:42.344326  9116 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.328972  9191 raft_consensus.cc:740] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:42.345396  9279 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:15:42.400230  9191 consensus_queue.cc:260] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.401546  9191 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.345561  8369 leader_election.cc:400] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
W20260709 12:15:42.403425  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 58003.4us
W20260709 12:15:42.404291  8371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.394071  9123 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.404805  8956 consensus_queue.cc:1059] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:42.408746  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:42.349802  8255 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.350831  9121 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.352952  8251 raft_consensus.cc:1275] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.355814  9113 consensus_queue.cc:237] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.358112  9110 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:42.364646  9022 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.366074  9014 raft_consensus.cc:3055] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:42.369566  9108 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.370004  8402 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:42.372416  9272 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.376585  9248 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:42.383817  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 66906.7us
W20260709 12:15:42.384884  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:42.374761  9278 log.cc:927] Time spent T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.143s	user 0.002s	sys 0.001s
W20260709 12:15:42.382330  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 271999us
I20260709 12:15:42.200326  9271 consensus_queue.cc:237] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.309866  9289 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:42.411542  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 536500us
I20260709 12:15:42.420634  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 160) took 1244 ms. Trace:
I20260709 12:15:42.421509  8480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 201) took 1137 ms. Trace:
I20260709 12:15:42.422413  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 310) took 1415 ms. Trace:
W20260709 12:15:42.426774  8445 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:42.463922  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.536680  8298 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:42.404350  8369 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:42.465709  8257 raft_consensus.cc:1240] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.438740  9231 consensus_queue.cc:237] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.385679  9244 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:42.377877  9124 consensus_meta.cc:287] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.002s
I20260709 12:15:42.476455  8404 raft_consensus.cc:1275] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:42.476747  9118 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.481853  9093 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.484901  8406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 150) took 1240 ms. Trace:
I20260709 12:15:42.488485  8296 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:42.550434  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 62059.7us
I20260709 12:15:42.495434  8400 raft_consensus.cc:1275] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:42.495446  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:42.550115  8406 rpcz_store.cc:276] 0709 12:15:41.244300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.605298 (+360998us) service_pool.cc:224] Handling call
0709 12:15:41.605582 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.605940 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.605967 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.627045 (+ 21078us) log.cc:844] Serialized 26 byte log entry
0709 12:15:42.096797 (+469752us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:42.096857 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.096954 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.484641 (+387687us) raft_consensus.cc:1685] finished
0709 12:15:42.484668 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.484828 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":513,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10836,"thread_start_us":442639,"threads_started":1,"wal-append.queue_time_us":705466}
I20260709 12:15:42.551981  8478 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.493937  9123 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:42.493829  8254 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 130) took 1681 ms (client timeout 1671 ms). Trace:
W20260709 12:15:42.552616  8254 rpcz_store.cc:269] 0709 12:15:40.802309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.068255 (+265946us) service_pool.cc:224] Handling call
0709 12:15:42.406568 (+1338313us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400516654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:42.483450 (+ 76882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528988928}
I20260709 12:15:42.532440  8221 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:42.531258  8480 rpcz_store.cc:276] 0709 12:15:41.284525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.853093 (+568568us) service_pool.cc:224] Handling call
0709 12:15:41.869301 (+ 16208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.276572 (+407271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:42.276605 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:42.276651 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:42.276682 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.421289 (+144607us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400344c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:42.421332 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.421453 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935986432}
I20260709 12:15:42.511355  9025 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.507063  8402 pending_rounds.cc:85] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 1
I20260709 12:15:42.555953  8402 pending_rounds.cc:107] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:42.556264  8402 raft_consensus.cc:2889] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:42.557013  8402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 151) took 1306 ms. Trace:
I20260709 12:15:42.557341  8402 rpcz_store.cc:276] 0709 12:15:41.250246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.604827 (+354581us) service_pool.cc:224] Handling call
0709 12:15:41.605145 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.334370 (+729225us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003799a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0ef1c0 00007f124e0f0231 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c
0709 12:15:42.556736 (+222366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.556951 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328091904}
I20260709 12:15:42.549896  9129 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.558598  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:42.503795  9014 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:42.610030  8478 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:42.513772  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:42.547760  8445 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:42.614077  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 66398.2us
I20260709 12:15:42.614504  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:42.539935  8956 consensus_queue.cc:1059] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
W20260709 12:15:42.549155  9131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.012s	sys 0.007s
I20260709 12:15:42.495843  8328 raft_consensus.cc:1240] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:42.553009  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:42.545436  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:42.623824  8406 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:42.622788  8256 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:42.624594  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:42.624975  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:42.545128  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.625712  8406 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:42.536700  9112 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:15:42.626725  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:42.549722  9276 consensus_queue.cc:1059] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:15:42.570142  8473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 106) took 1530 ms (client timeout 1505 ms). Trace:
W20260709 12:15:42.559134  9249 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:15:42.531177  8249 rpcz_store.cc:276] 0709 12:15:41.176782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.598891 (+422109us) service_pool.cc:224] Handling call
0709 12:15:41.877152 (+278261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:41.937763 (+ 60611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.420353 (+482590us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540048b2d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:42.420547 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477746432}
I20260709 12:15:42.560370  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:42.550069  9108 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.577891  8475 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
W20260709 12:15:42.565976  9239 consensus_meta.cc:287] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.003s
W20260709 12:15:42.576344  9241 consensus_meta.cc:287] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
W20260709 12:15:42.579516  9245 consensus_meta.cc:287] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.003s
I20260709 12:15:42.548699  9124 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.536028  8399 rpcz_store.cc:276] 0709 12:15:41.006980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.475068 (+468088us) service_pool.cc:224] Handling call
0709 12:15:41.475389 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.019689 (+544300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.422170 (+402481us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001e1c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:42.422354 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997055872}
I20260709 12:15:42.527627  9248 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.573874  9272 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.570641  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 164) took 1221 ms. Trace:
I20260709 12:15:42.559381  9286 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:42.533289  8398 raft_consensus.cc:1275] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.547183  8404 pending_rounds.cc:85] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 1
I20260709 12:15:42.551867  9121 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:42.616518  8445 leader_election.cc:343] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.676952  8445 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:42.677961  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 61488.1us
I20260709 12:15:42.619095  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:42.636180  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 103864us
I20260709 12:15:42.638505  9014 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.616027  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:42.617463  9031 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.617328  9289 raft_consensus.cc:697] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:42.634224  9275 consensus_queue.cc:1048] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:15:42.623198  9085 consensus_queue.cc:1059] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:15:42.641219  9204 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:15:42.634223  8473 rpcz_store.cc:269] 0709 12:15:41.039550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.062025 (+ 22475us) service_pool.cc:224] Handling call
0709 12:15:42.569906 (+1507881us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001fefd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:42.570055 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420094848}
I20260709 12:15:42.644320  9206 raft_consensus.cc:3055] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:15:42.626717  9131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.013s	sys 0.007s
W20260709 12:15:42.651413  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.566526  9022 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:42.652532  9241 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.656054  8400 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:42.648913  9108 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.612742  9134 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:15:42.661962  8403 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:42.789299  8403 pending_rounds.cc:85] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 1
I20260709 12:15:42.789726  8403 pending_rounds.cc:107] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:42.790045  8403 raft_consensus.cc:2889] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:42.661818  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:42.618124  9092 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.672041  8330 raft_consensus.cc:1275] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.674521  8257 rpcz_store.cc:276] 0709 12:15:41.348907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.767778 (+418871us) service_pool.cc:224] Handling call
0709 12:15:42.465524 (+697746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.538883 (+ 73359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.570415 (+ 31532us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400516650. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:42.570580 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451595520}
I20260709 12:15:42.650305  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:42.701910  8402 raft_consensus.cc:1275] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:42.802436  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 95598.9us
I20260709 12:15:42.707530  8222 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:42.803581  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 96204.3us
I20260709 12:15:42.804576  8222 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:42.676589  8404 pending_rounds.cc:107] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:42.673028  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:42.710318  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.703969  9031 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.682281  9286 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.695979  9205 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.703732  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:42.703346  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:42.808421  8222 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:42.675755  8324 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:42.822125  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 62126.2us
W20260709 12:15:42.814224  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.723680  9206 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:42.736919  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:42.820076  8974 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:42.821332  8956 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:42.828363  8296 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:42.738178  9204 raft_consensus.cc:697] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:42.801964  8892 raft_consensus.cc:3055] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.830803  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:42.802897  9213 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.811482  8404 raft_consensus.cc:2889] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:42.814659  9280 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.852828  8480 raft_consensus.cc:2393] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 2: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:42.817086  9085 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:42.844496  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 851364us
I20260709 12:15:42.820155  9286 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.840349  8406 raft_consensus.cc:1275] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.736331  9025 consensus_queue.cc:1048] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.085s
W20260709 12:15:42.854598  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 51300.7us
I20260709 12:15:42.845257  8474 raft_consensus.cc:1275] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.849617  9148 raft_consensus.cc:2749] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.859877  8405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 307) took 1845 ms. Trace:
I20260709 12:15:42.864979  8956 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.871569  8297 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:42.871753  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 467428us
I20260709 12:15:42.851892  8398 raft_consensus.cc:1275] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:42.852190  9129 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.852866  8974 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:42.855571  8892 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:42.856565  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:42.869357  8405 rpcz_store.cc:276] 0709 12:15:41.006070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.454521 (+448451us) service_pool.cc:224] Handling call
0709 12:15:41.467373 (+ 12852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:41.628826 (+161453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:41.628855 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:41.629314 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:15:41.920166 (+290852us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:41.945248 (+ 25082us) log.cc:844] Serialized 14 byte log entry
0709 12:15:42.841776 (+896528us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800127780. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124b002a40 00007f124affd4e4 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287 00007f124e108208
0709 12:15:42.842009 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.842120 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:42.842179 (+    59us) raft_consensus.cc:1685] finished
0709 12:15:42.851241 (+  9062us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:42.851381 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6851,"prepare.queue_time_us":24344,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":905076,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":17235,"spinlock_wait_cycles":26129792,"thread_start_us":236397,"threads_started":1,"wal-append.queue_time_us":443704}
W20260709 12:15:42.913700  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.920605  9226 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:42.921253  9226 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.921627  9249 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.922155  9249 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.923651  9204 consensus_queue.cc:237] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:42.927606  8527 tablet_bootstrap.cc:492] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
W20260709 12:15:42.928069  9311 log.cc:927] Time spent T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:15:42.928252  8527 ts_tablet_manager.cc:1403] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 1.348s	user 0.021s	sys 0.020s
W20260709 12:15:42.928455  9310 log.cc:927] Time spent T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:15:42.928335  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:42.842865  9289 consensus_queue.cc:237] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.929481  8248 raft_consensus.cc:2393] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:42.851919  9274 consensus_queue.cc:1048] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.278s
I20260709 12:15:42.931289  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:42.870847  8993 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:42.932036  8405 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:42.857885  9213 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:42.930800  9309 log.cc:927] Time spent T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:15:42.941664  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:42.898417  8249 raft_consensus.cc:1275] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:42.922861  9306 log.cc:927] Time spent T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 12:15:42.896592  9245 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.905930  8974 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:42.864230  9085 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:42.932659  9124 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:42.958971  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 87476.3us
I20260709 12:15:42.918753  8404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 306) took 2386 ms. Trace:
I20260709 12:15:42.869400  9267 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:42.963572  8527 raft_consensus.cc:359] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:42.944903  9239 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:42.978474  8527 raft_consensus.cc:385] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.980813  9322 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:42.982079  9226 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:42.938951  9093 consensus_queue.cc:1048] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:42.983332  8527 raft_consensus.cc:740] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.999567  8527 consensus_queue.cc:260] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.001484  8527 ts_tablet_manager.cc:1434] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:15:43.002116  9320 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.002388  9325 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:42.982779  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 993217us
I20260709 12:15:43.002806  9320 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.003364  9325 raft_consensus.cc:697] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:43.003783  8372 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.005345  8372 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:43.004801  9325 consensus_queue.cc:237] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.006553  9085 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.007509  8993 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.008311  8993 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:43.009747  9320 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.010598  9320 consensus_queue.cc:1048] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.011345  9322 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:43.011812  9322 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.012072  9320 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.012205  9322 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.012631  9320 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.002724  8527 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
W20260709 12:15:42.994611  9308 log.cc:927] Time spent T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:15:42.973002  8404 rpcz_store.cc:276] 0709 12:15:40.530038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.006232 (+476194us) service_pool.cc:224] Handling call
0709 12:15:41.046056 (+ 39824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.871348 (+1825292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.916212 (+ 44864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:42.990373  9239 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:42.973562  9245 raft_consensus.cc:697] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:42.997625  9317 raft_consensus.cc:3055] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:42.988294  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.017328  9248 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.034456  8956 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:42.975564  8892 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.035948  9108 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.037165  9124 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.035591  9317 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:43.030493  9085 consensus_queue.cc:1048] T 0fde30635c7f45dead7584c98d2d807d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 12:15:43.143463  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.075268  8324 raft_consensus.cc:1275] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:43.142139  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 171772us
I20260709 12:15:43.069636  9191 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.086079  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.151814  8297 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:43.091233  9031 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:43.143234  9309 log.cc:927] Time spent T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:15:43.173468  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 157756us
I20260709 12:15:43.178344  8527 tablet_bootstrap.cc:654] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.154762  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.067965  8372 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:43.180787  8403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 153) took 1878 ms. Trace:
I20260709 12:15:43.181306  8403 rpcz_store.cc:276] 0709 12:15:41.302688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.657242 (+354554us) service_pool.cc:224] Handling call
0709 12:15:41.659131 (+  1889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.797046 (+1137915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.180473 (+383427us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540001c554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:43.180718 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285387008}
W20260709 12:15:43.181061  9118 consensus_meta.cc:287] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.003s
I20260709 12:15:43.155499  9205 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.183960  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 176) took 1883 ms. Trace:
I20260709 12:15:43.154273  8892 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.156221  9248 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:15:43.192653  9296 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.169121  9191 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:43.196645  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 161453us
I20260709 12:15:43.196980  9296 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.197985  8372 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.198889  9323 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.199433  9323 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:43.199532  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.199883  9323 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.145988  9124 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:43.201694  9272 consensus_meta.cc:287] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:15:43.191920  8256 rpcz_store.cc:276] 0709 12:15:41.296734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.684827 (+388093us) service_pool.cc:224] Handling call
0709 12:15:41.726689 (+ 41862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.626428 (+899739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.179466 (+553038us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400516154. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:43.179671 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050391808}
I20260709 12:15:43.206255  9267 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.206300  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.206851  8372 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.207798  9267 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:43.182125  9244 consensus_meta.cc:287] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.635s	user 0.000s	sys 0.012s
W20260709 12:15:43.211612  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 59891.9us
W20260709 12:15:43.216351  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.219832  9191 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:43.209103  9124 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:43.190938  9108 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.183606  9249 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.190601  9190 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:43.217994  9244 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:43.253553  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.255548  9213 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:43.258600  9304 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.466s	user 0.000s	sys 0.001s
I20260709 12:15:43.222047  9327 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.172712  9245 consensus_queue.cc:237] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.183764  9324 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:43.279989  9324 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.282524  9324 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.211393  8250 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:43.247690  8372 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.212527  9205 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.223917  8398 raft_consensus.cc:1275] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:43.276196  9327 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.269479  8256 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:43.286425  8253 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:43.291733  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.286247  9108 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.270471  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.294694  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.292393  8332 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
W20260709 12:15:43.284296  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 62434.8us
I20260709 12:15:43.291199  9324 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.348682  8527 tablet_bootstrap.cc:492] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:43.292577  9327 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.352082  8527 ts_tablet_manager.cc:1403] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.350s	user 0.008s	sys 0.022s
I20260709 12:15:43.307915  8443 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:43.310786  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:43.349273  9161 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.348842  9322 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.361351  9108 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.344396  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.308596  9296 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:43.347558  8974 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.364897  9205 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:43.349097  9110 consensus_meta.cc:287] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.844s	user 0.006s	sys 0.006s
W20260709 12:15:43.371791  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 63989.1us
I20260709 12:15:43.374194  9342 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.311136  9234 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.311180  9330 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.311702  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.374586  8372 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.316979  8404 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:43.297528  9206 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.370689  9239 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.393558  9014 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.394945  9205 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.397635  8970 raft_consensus.cc:3055] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:43.400671  9249 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.310906  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.387589  9342 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.377065  9161 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.406970  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.407953  8248 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:43.410715  8329 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:43.403863  9234 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.439060  9323 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.470213  9323 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.472358  9110 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.473170  9110 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:43.440086  9284 log.cc:927] Time spent T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 1.201s	user 0.004s	sys 0.000s
I20260709 12:15:43.447301  8974 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.452427  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:43.455300  9286 consensus_meta.cc:287] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.009s
I20260709 12:15:43.455826  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.456502  8401 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:43.418437  9205 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.418583  9239 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.420831  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.457878  8400 raft_consensus.cc:3055] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:15:43.429306  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 54873.3us
I20260709 12:15:43.405838  9330 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.460155  8443 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:43.460386  9317 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.464541  9213 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.416028  8970 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:43.485559  9275 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.425446  9342 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.486441  9296 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:43.433883  8474 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:43.480854  9191 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.427459  9249 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.491451  8400 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:43.487969  9286 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.537313  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.537721  9286 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.538877  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.539711  8401 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 0.
I20260709 12:15:43.540059  9205 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.519970  9239 consensus_queue.cc:1059] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:15:43.540699  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:43.541254  9239 consensus_queue.cc:1243] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 29d436e9d3d54fe599d9aa67d38fba03 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:43.541929  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.542085  9239 consensus_queue.cc:1059] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.543566  9322 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.545069  8400 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:43.530026  8372 leader_election.cc:400] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:43.531287  9124 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.531939  9113 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.533869  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.504168  9213 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.522678  9317 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.518041  9191 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.529230  9330 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.549360  8527 raft_consensus.cc:359] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.542651  8401 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
W20260709 12:15:43.529199  9301 log.cc:927] Time spent T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.859s	user 0.003s	sys 0.000s
W20260709 12:15:43.557524  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:43.557050  8153 catalog_manager.cc:5697] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 1 to 2, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.560451  9267 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:43.562453  8151 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37604 (request call id 95) took 6620 ms. Trace:
I20260709 12:15:43.581643  8153 catalog_manager.cc:5697] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 reported cstate change: term changed from 1 to 2, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to b3421ee20b674b879e0633e39c5709d7 (127.3.34.195). New cstate: current_term: 2 leader_uuid: "b3421ee20b674b879e0633e39c5709d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.563802  8332 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:15:43.564244  8331 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:43.576504  8527 raft_consensus.cc:385] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.558817  9249 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.565426  9124 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.583415  8332 pending_rounds.cc:85] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 1
I20260709 12:15:43.583652  8527 raft_consensus.cc:740] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.587677  8332 pending_rounds.cc:107] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:15:43.588009  8332 raft_consensus.cc:2889] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:43.565851  8372 leader_election.cc:403] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:43.585529  8445 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:43.589401  9205 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:43.591593  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 131539us
I20260709 12:15:43.573985  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.588136  8527 consensus_queue.cc:260] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.581555  8151 rpcz_store.cc:276] 0709 12:15:36.964294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:36.987557 (+ 23263us) service_pool.cc:224] Handling call
0709 12:15:43.562334 (+6574777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:41.416731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:41.424192 (+  7461us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:41.424291 (+    99us) write_op.cc:435] Acquired schema lock
0709 12:15:41.424314 (+    23us) tablet.cc:662] Decoding operations
0709 12:15:41.425312 (+   998us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:41.425422 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:41.425452 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:15:41.426127 (+   675us) tablet.cc:701] Row locks acquired
0709 12:15:41.426166 (+    39us) write_op.cc:260] PREPARE: finished
0709 12:15:41.426343 (+   177us) write_op.cc:270] Start()
0709 12:15:41.426508 (+   165us) write_op.cc:276] Timestamp: P: 1783599341426271 usec, L: 0
0709 12:15:41.426541 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:15:41.437135 (+ 10594us) log.cc:844] Serialized 2074 byte log entry
0709 12:15:41.909440 (+472305us) op_driver.cc:464] REPLICATION: finished
0709 12:15:42.241182 (+331742us) write_op.cc:301] APPLY: starting
0709 12:15:42.241280 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:42.241447 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:42.241567 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:42.242309 (+   742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:42.242500 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:15:42.242541 (+    41us) write_op.cc:312] APPLY: finished
0709 12:15:42.242789 (+   248us) log.cc:844] Serialized 46 byte log entry
0709 12:15:42.242953 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.243092 (+   139us) write_op.cc:454] Released schema lock
0709 12:15:42.243140 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:42.243513 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:42.243560 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43575,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":314309,"apply.run_cpu_time_us":2330,"apply.run_wall_time_us":12165,"num_ops":5,"prepare.queue_time_us":246631,"prepare.run_cpu_time_us":17058,"prepare.run_wall_time_us":80728,"raft.queue_time_us":227101,"raft.run_cpu_time_us":9618,"raft.run_wall_time_us":183668,"replication_time_us":422965,"thread_start_us":243423,"threads_started":4,"wal-append.queue_time_us":71517,"wal-append.run_cpu_time_us":71280,"wal-append.run_wall_time_us":1751986}]]}
I20260709 12:15:43.610436  8296 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:43.611641  9014 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.612082  9014 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.584587  9334 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.593537  9124 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.575857  8397 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
W20260709 12:15:43.599073  9346 log.cc:927] Time spent T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:15:43.593580  8400 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.617858  9014 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.593333  9110 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.579891  9087 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.572697  9113 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.574410  8970 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.618103  9249 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.656756  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 209) took 1405 ms. Trace:
I20260709 12:15:43.665913  9320 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.664973  8479 rpcz_store.cc:276] 0709 12:15:42.251722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.292148 (+ 40426us) service_pool.cc:224] Handling call
0709 12:15:42.292435 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:42.292804 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:42.292836 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:42.293362 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:15:42.415396 (+122034us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b48002604d8. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253016aa1 00007f125300db37 00007f125300d9ca 00007f125310526f 00007f1253104f37 00007f125311955c 00007f1253119508 00007f1253119488 00007f1253119443 00007f12531186ec 00007f1252042a96
0709 12:15:42.529927 (+114531us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:42.530011 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.530113 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:43.528554 (+998441us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:43.656403 (+127849us) raft_consensus.cc:1685] finished
0709 12:15:43.656436 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:43.656669 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":951,"raft.run_cpu_time_us":2772,"raft.run_wall_time_us":121848,"spinlock_wait_cycles":406251904,"thread_start_us":236121,"threads_started":1,"wal-append.queue_time_us":376063}
I20260709 12:15:43.666327  9286 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.646553  8527 ts_tablet_manager.cc:1434] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.293s	user 0.002s	sys 0.006s
W20260709 12:15:43.666980  9347 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:15:43.667953  8397 raft_consensus.cc:1275] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.669392  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:43.670100  8397 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.678121  9116 raft_consensus.cc:3055] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:43.678755  9116 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:43.679983  9116 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.615839  8404 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:43.681596  9116 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:43.683157  8404 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:43.684882  8323 raft_consensus.cc:1275] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.685904  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 306) took 1063 ms. Trace:
I20260709 12:15:43.657917  9087 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:43.690016  9321 log.cc:927] Time spent T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.797s	user 0.000s	sys 0.003s
I20260709 12:15:43.663255  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.659904  9161 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.656502  9352 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.704237  9352 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:43.704797  9352 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.613554  9205 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.703337  9206 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.667032  9286 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:43.719038  8475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 195) took 2437 ms (client timeout 2085 ms). Trace:
I20260709 12:15:43.719848  9286 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.723863  9234 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.724540  8970 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:43.727551  9113 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:43.742816  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 142540us
I20260709 12:15:43.743441  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:43.748757  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:43.644071  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 114183us
W20260709 12:15:43.719553  8475 rpcz_store.cc:269] 0709 12:15:41.281381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:41.474465 (+193084us) service_pool.cc:224] Handling call
0709 12:15:43.718745 (+2244280us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400017054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:43.718902 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092736896}
W20260709 12:15:43.753398  8445 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:43.757663  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.632486  9334 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.761643  8406 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
W20260709 12:15:43.769879  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.762317  8445 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:43.771860  8445 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:43.686573  8323 rpcz_store.cc:276] 0709 12:15:42.622305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.623009 (+   704us) service_pool.cc:224] Handling call
0709 12:15:43.684069 (+1061060us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:43.684367 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:43.685527 (+  1160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.685822 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7175040}
W20260709 12:15:43.747131  9300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.024s	sys 0.023s
W20260709 12:15:43.783633  9300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.024s	sys 0.023s
I20260709 12:15:43.786610  9191 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.786618  9322 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:43.789255  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.773737  8472 raft_consensus.cc:1275] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.781199  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:43.759268  9205 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:43.797801  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.777704  8398 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.798491  8478 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:43.763769  9092 consensus_queue.cc:1048] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:15:43.791335  9191 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:43.782503  9231 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.818928  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.822063  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.822503  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:43.822743  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.823153  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.823717  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.824903  8474 raft_consensus.cc:1275] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:43.825022  9014 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.825456  9334 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:43.826095  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.799376  9190 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:43.827386  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.827505  9191 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.828117  8400 raft_consensus.cc:1275] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:15:43.828286  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.830574  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.831713  8480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 240) took 1139 ms. Trace:
I20260709 12:15:43.831970  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.833091  8330 raft_consensus.cc:1275] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:43.833493  9161 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:43.833659  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.833922  9245 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.822566  9087 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:43.837164  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.853259  9234 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:43.856310  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.894321  8479 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.894654  8406 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:43.858618  8298 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:43.864477  8478 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
W20260709 12:15:43.873000  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:43.820384  8956 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.799075  9342 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.868479  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.877960  8480 rpcz_store.cc:276] 0709 12:15:42.692744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.863607 (+170863us) service_pool.cc:224] Handling call
0709 12:15:42.871292 (+  7685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:42.932843 (+ 61551us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:43.041283 (+108440us) log.cc:844] Serialized 14 byte log entry
0709 12:15:43.154659 (+113376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:43.154709 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:43.154752 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.831474 (+676722us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b54003057d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:43.831523 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:43.831648 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5219,"prepare.queue_time_us":284590,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":10056,"raft.queue_time_us":2141,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":16477,"spinlock_wait_cycles":141078400,"thread_start_us":199707,"threads_started":2,"wal-append.queue_time_us":168392}
I20260709 12:15:43.810797  9322 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.879163  8400 pending_rounds.cc:85] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 1
I20260709 12:15:43.867175  8328 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:43.872433  9112 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.784832  9226 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:43.875713  9148 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.895982  8298 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:43.875159  9190 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.901405  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:43.901314  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.864385  9113 consensus_queue.cc:1059] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:15:43.865427  9274 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:15:43.875499  9280 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:43.903517  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.887120  8970 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:43.900635  8323 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:43.963263  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:43.875890  9352 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:43.904858  9327 consensus_meta.cc:287] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.531s	user 0.015s	sys 0.000s
I20260709 12:15:43.891724  8327 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:43.907968  8324 raft_consensus.cc:2393] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:43.964972  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.896124  9245 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.969087  8330 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:43.961495  9204 consensus_queue.cc:1048] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:43.907699  8471 raft_consensus.cc:2393] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 1: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:43.900869  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.961377  8329 raft_consensus.cc:2368] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:43.972079  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:43.973692  8406 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:44.001322  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.908210  9351 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.898669  9355 raft_consensus.cc:2749] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:43.887722  9161 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:43.965935  8400 pending_rounds.cc:107] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:15:43.959880  9300 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.904919  9110 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:43.905820  8252 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 170) took 1318 ms (client timeout 1577 ms). Trace:
I20260709 12:15:43.977371  8443 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:43.907632  9272 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.962852  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.965770  9226 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:43.969151  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 73242.8us
I20260709 12:15:43.983664  8370 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.082029  9226 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:44.082460  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 98868.9us
I20260709 12:15:44.082976  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:44.084371  8298 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:43.973330  9313 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:43.972692  9190 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.086218  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.087822  9239 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.088263  9239 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.088630  9239 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.089295  9206 raft_consensus.cc:3055] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:44.089704  9206 raft_consensus.cc:740] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:43.901736  9234 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.090487  9206 consensus_queue.cc:260] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.091219  9267 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.091737  9206 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.091990  9324 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.065709  8400 raft_consensus.cc:2889] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:44.092492  9324 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.092475  9161 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.906199  8956 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.094638  9324 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:43.975468  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.978219  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:43.967384  9112 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:43.977985  8970 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:43.978936  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:43.987557  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.007225  8479 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:44.010140  9322 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.010430  9245 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.010620  9213 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:43.973017  9148 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.012040  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.132180  8402 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:44.133409  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.016044  9229 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:44.016844  8222 leader_election.cc:343] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.135475  8222 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:44.019353  9323 raft_consensus.cc:3055] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:44.025950  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.030604  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 207) took 1845 ms. Trace:
I20260709 12:15:44.031687  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 193) took 1074 ms. Trace:
I20260709 12:15:44.034090  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.139979  8256 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:44.035784  9307 log.cc:927] Time spent T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 1.365s	user 0.004s	sys 0.000s
I20260709 12:15:44.037906  9274 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.038046  9249 raft_consensus.cc:2749] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:44.038398  9231 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:44.040680  9191 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.137532  9323 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:44.045332  9330 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.045488  9113 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.046267  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.047410  9352 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.049319  8405 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 226) took 1176 ms. Trace:
W20260709 12:15:44.051780  9361 log.cc:927] Time spent T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:15:44.051872  8527 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:43.991771  9286 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:43.981240  9327 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.007731  9014 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.008172  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.055823  8327 raft_consensus.cc:1240] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:15:44.026561  9351 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.009083  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.064654  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.154276  8405 rpcz_store.cc:276] 0709 12:15:42.872827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.953883 (+ 81056us) service_pool.cc:224] Handling call
0709 12:15:43.444728 (+490845us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:44.048367 (+603639us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:44.048573 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:44.048900 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.048928 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:44.049049 (+   121us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:44.049086 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:44.049147 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:44.049261 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1200,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"spinlock_wait_cycles":92715520}
I20260709 12:15:43.996994  8477 raft_consensus.cc:2393] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:44.031302  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:43.977164  9280 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:44.072556  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 95264.5us
W20260709 12:15:44.072286  8252 rpcz_store.cc:269] 0709 12:15:42.584113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.610267 (+ 26154us) service_pool.cc:224] Handling call
0709 12:15:43.823591 (+1213324us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:43.902115 (+ 78524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23559936}
I20260709 12:15:44.077165  9272 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.078296  9085 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:43.970701  8255 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:44.093247  8400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 326) took 1458 ms. Trace:
I20260709 12:15:43.968745  9289 consensus_queue.cc:1048] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:44.096218  9320 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:44.095317  9157 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:15:44.096508  8297 leader_election.cc:343] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.096846  9313 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.097788  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:44.094720  9317 consensus_meta.cc:287] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.003s
I20260709 12:15:44.001935  9358 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:44.213665  9366 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:44.213995  9358 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.095465  8956 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.091711  9267 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.215545  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.216437  9358 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.216706  9267 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.217259  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 213) took 1867 ms. Trace:
I20260709 12:15:44.216732  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.219249  8403 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:44.103921  8257 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:44.074498  9110 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.056818  9124 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:44.112144  8298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41731 timed out after 1.577s (SENT) [suppressed 10 similar messages]
I20260709 12:15:44.066560  9025 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.084400  8370 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.142100  8248 rpcz_store.cc:276] 0709 12:15:42.957633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.959437 (+  1804us) service_pool.cc:224] Handling call
0709 12:15:44.031488 (+1072051us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540053ded4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:44.031617 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766831488}
I20260709 12:15:43.996702  8478 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:44.092473  9234 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.126200  8331 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:44.237577  9110 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.136287  8402 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 2: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:44.240146  9190 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.240832  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.241681  9124 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.241787  8402 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:44.242623  9190 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:44.136334  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 119522us
I20260709 12:15:44.143831  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.272593  8256 raft_consensus.cc:2410] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:44.147203  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.130686  8474 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:44.044893  9342 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.120157  9161 consensus_queue.cc:1048] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:44.152184  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.158469  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.149094  8329 raft_consensus.cc:1275] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:44.138717  9291 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.167208  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.144773  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.138780  8974 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:15:44.196619  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.254921  9148 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.200448  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.291471  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.200963  8443 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:44.201561  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 105084us
W20260709 12:15:44.292335  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 91454.5us
I20260709 12:15:44.160962  9087 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.160024  9286 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:44.207705  9364 log.cc:927] Time spent T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:15:44.209693  8397 consensus_meta.cc:287] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.003s
I20260709 12:15:44.200150  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.210934  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.211349  9272 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.211678  9118 consensus_queue.cc:1059] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.213240  9327 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.213462  9280 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.074944  9300 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.098007  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.221388  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.226276  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.305709  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.306150  8250 raft_consensus.cc:2410] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:44.306361  8257 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:44.306919  9272 raft_consensus.cc:3055] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:44.307338  9272 raft_consensus.cc:740] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:44.307411  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:44.171736  9085 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.308112  8527 tablet_bootstrap.cc:654] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.168745  8398 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:44.308194  9272 consensus_queue.cc:260] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.297608  8397 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:44.309621  9272 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.309847  9300 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.160465  9113 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.310801  8399 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:44.304057  8253 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:44.303552  8475 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:44.311920  9204 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:44.312441  8253 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:44.313061  9113 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.217761  8476 rpcz_store.cc:276] 0709 12:15:42.349404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.397693 (+ 48289us) service_pool.cc:224] Handling call
0709 12:15:42.398026 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:42.398246 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:42.398273 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:42.398747 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:15:42.547661 (+148914us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:42.547723 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:42.606936 (+ 59213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:44.035186 (+1428250us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:44.200794 (+165608us) raft_consensus.cc:1685] finished
0709 12:15:44.200814 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:44.217183 (+ 16369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393624448,"thread_start_us":103441,"threads_started":1,"wal-append.queue_time_us":271248}
I20260709 12:15:44.314461  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.315140  9351 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.295509  9206 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:15:44.315694  8473 raft_consensus.cc:2393] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:44.315951  8401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 172) took 1096 ms. Trace:
I20260709 12:15:44.235260  9267 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.296018  9087 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.316912  9267 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:44.246596  9025 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.317387  9267 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.247200  9239 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.248255  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:44.248401  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 131119us
I20260709 12:15:44.319067  9025 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.319343  8252 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:44.319547  8369 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.244750  9226 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.320549  8369 leader_election.cc:400] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:44.320614  8252 raft_consensus.cc:1240] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:44.320861  8369 leader_election.cc:403] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:44.250643  9289 consensus_queue.cc:1059] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.322125  9286 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.322724  9289 raft_consensus.cc:3055] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:44.140970  8472 rpcz_store.cc:276] 0709 12:15:42.185574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.240732 (+ 55158us) service_pool.cc:224] Handling call
0709 12:15:43.737411 (+1496679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:43.791206 (+ 53795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:44.030321 (+239115us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400017050. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:44.030521 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420794112}
I20260709 12:15:44.251631  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.300576  9336 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:15:44.323491  9161 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.323716  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:44.324558  8472 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.297952  9342 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.325213  9342 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.325659  9342 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.151237  9274 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.323174  9249 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.327399  9249 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:44.327764  9249 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.328714  9274 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:44.230852  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 146564us
I20260709 12:15:44.329950  8370 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:44.330056  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.255790  8970 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.258157  9191 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.260887  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.259339  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:44.275437  8222 consensus_peers.cc:597] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 -> Peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245): Couldn't send request to peer b3421ee20b674b879e0633e39c5709d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:44.344640  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 69381.3us
I20260709 12:15:44.345294  8222 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:44.346473  8222 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.276180  9022 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.353390  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.278813  8254 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:44.282698  8402 raft_consensus.cc:1275] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:44.283223  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 171093us
I20260709 12:15:44.354122  8403 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:44.286913  8406 raft_consensus.cc:1275] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:44.235642  9112 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:44.159857  9330 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.289113  8479 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:44.296041  8297 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.299310  8405 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:44.299834  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:44.357645  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 61697.6us
I20260709 12:15:44.301813  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.358352  8255 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
W20260709 12:15:44.358429  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.315850  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.194118  8400 rpcz_store.cc:276] 0709 12:15:42.635397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.826210 (+190813us) service_pool.cc:224] Handling call
0709 12:15:42.868571 (+ 42361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:43.457717 (+589146us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54000db4a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0ef1c0 00007f124e0f0231 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c
0709 12:15:43.544617 (+ 86900us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54000db4a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e06b06f 00007f124e0e3f60 00007f124e0e57de 00007f124e0efb49 00007f124e0f0416 00007f124e0ecd8f 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62
0709 12:15:44.092944 (+548327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:44.093183 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191051392}
I20260709 12:15:44.316728  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.230834  9323 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.361487  9323 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.322975  8480 raft_consensus.cc:2393] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:44.263226  8446 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:44.331219  8370 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:44.334971  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.364351  8331 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:44.364880  8370 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:44.339432  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.341840  9191 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.342078  8372 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:44.343220  8248 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:44.277161  9110 consensus_queue.cc:1048] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.284372  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.358361  8297 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.136619  8330 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:44.323127  9289 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:44.367818  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.385427  8298 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:44.375077  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:44.386476  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.395567  8331 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:44.389319  8220 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:44.396483  8402 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.368403  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:44.353592  8445 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:44.390561  8256 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.391528  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.344859  9085 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:44.342700  9245 consensus_queue.cc:1048] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:15:44.312510  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:44.391358  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 128266us
W20260709 12:15:44.401949  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 43659.4us
I20260709 12:15:44.322145  9226 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.395583  8403 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.403872  8297 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:44.404085  8298 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:44.399377  8220 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:44.356775  9157 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:44.408223  8297 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:44.367637  9352 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.410633  8446 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:44.408558  8298 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:44.410405  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 56892.8us
I20260709 12:15:44.411429  8479 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:44.369445  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:44.415170  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 50406.4us
I20260709 12:15:44.415401  8445 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.416003  8370 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:44.416874  8446 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:44.380237  9113 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:44.381462  9206 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.387744  9275 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.387224  9300 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.381102  9356 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.418705  8221 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:44.405779  9112 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.405251  8956 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.425414  8222 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:44.400754  8892 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.401144  9324 raft_consensus.cc:2749] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.409770  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.427749  8298 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:44.421288  9239 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.405957  9327 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.434754  9148 consensus_queue.cc:1059] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:44.423537  9231 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.431447  9300 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.442378  9327 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.413967  9317 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.425319  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.425700  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.419009  9190 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.418349  9355 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.419587  8474 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.436334  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.414139  9352 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.422120  9320 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.506495  9320 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.506906  9320 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.509927  8472 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:44.419054  9226 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:44.439972  9205 consensus_queue.cc:1059] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:15:44.405187  8324 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:44.441074  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.511799  9191 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.442881  9231 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.512723  9231 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.512910  9330 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.422350  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.414427  9286 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:44.421785  9234 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:44.422192  9206 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.407092  9280 consensus_queue.cc:1048] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:15:44.409726  9118 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:15:44.424710  9275 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.544910  9275 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.429045  8954 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.549717  8256 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:44.549940  8954 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.431977  9112 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:44.440001  9235 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:44.424682  9014 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:44.436056  8892 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.444072  9123 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.474681  8402 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:44.510824  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.559266  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.427470  9113 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.456382  9110 consensus_queue.cc:1048] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:15:44.502653  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.503396  9148 raft_consensus.cc:3055] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:15:44.503971  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 57843us
I20260709 12:15:44.504087  9025 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:44.505858  8327 raft_consensus.cc:1275] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:44.511210  9087 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.583671  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.584364  8402 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:44.584228  9235 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:44.585413  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.559191  8892 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.586066  8402 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:44.557956  9123 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:44.498138  9377 log.cc:927] Time spent T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:15:44.452584  9129 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:44.452095  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.461377  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.456056  9324 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:44.498741  9355 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.500193  9190 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.437110  9031 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.439781  8956 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.514082  9352 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.551443  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.523129  8403 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:44.537622  9286 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.536587  9234 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.580029  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.560806  8954 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:44.550949  9372 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:15:44.591903  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.451187  9289 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.542210  9206 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.316444  8401 rpcz_store.cc:276] 0709 12:15:43.219771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:43.591189 (+371418us) service_pool.cc:224] Handling call
0709 12:15:43.591605 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:43.612998 (+ 21393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:43.614312 (+  1314us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:43.694698 (+ 80386us) log.cc:844] Serialized 26 byte log entry
0709 12:15:43.965852 (+271154us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:43.971634 (+  5782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:43.975008 (+  3374us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:44.315727 (+340719us) raft_consensus.cc:1685] finished
0709 12:15:44.315745 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:44.315889 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1794,"raft.queue_time_us":16996,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":2642,"thread_start_us":210394,"threads_started":1,"wal-append.queue_time_us":309021}
I20260709 12:15:44.560002  9204 raft_consensus.cc:2764] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:15:44.594736  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:44.595656  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 156641us
I20260709 12:15:44.601673  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:44.607560  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 149159us
I20260709 12:15:44.587337  9123 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.560637  9112 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.692575  8474 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:44.613370  8222 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.695384  8479 raft_consensus.cc:1240] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:15:44.587692  9093 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:44.580224  9148 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:44.694082  8402 raft_consensus.cc:1240] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:15:44.610103  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 268104us
W20260709 12:15:44.622884  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:44.592875  9129 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.661095  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:44.610538  8970 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.665729  8403 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.592074  8250 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:44.594689  9336 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:44.664897  8445 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.663371  9300 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.649609  9291 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.650408  9157 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.655658  9031 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.674443  8406 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:44.650647  9355 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.691143  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:44.666932  9286 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:44.701898  8332 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:44.579936  9313 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:44.674530  9356 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:44.706745  9129 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:44.653437  9190 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.675122  9234 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:44.691215  9289 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:44.723542  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 58735.2us
I20260709 12:15:44.723717  8330 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:44.696964  9148 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:44.707295  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 94045.3us
I20260709 12:15:44.707979  9093 raft_consensus.cc:697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:44.723155  9274 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.787748  8222 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:44.713898  9336 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.722816  9031 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:44.724709  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.743023  9118 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:44.836005  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 48003.1us
I20260709 12:15:44.701074  9245 consensus_queue.cc:1048] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:15:44.740694  9124 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:44.714489  9022 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.815207  9336 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:44.838326  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 68702.1us
I20260709 12:15:44.724834  9291 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.750741  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:44.726094  9157 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.792232  9327 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.837605  9161 raft_consensus.cc:2749] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:44.842376  9022 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.800909  9274 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.847739  9124 raft_consensus.cc:697] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:44.841413  9118 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.841872  8372 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:44.867051  9323 consensus_meta.cc:287] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.003s
I20260709 12:15:44.879622  8527 tablet_bootstrap.cc:492] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:44.864210  9022 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:44.880677  8527 ts_tablet_manager.cc:1403] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.829s	user 0.041s	sys 0.051s
W20260709 12:15:44.881565  9390 log.cc:927] Time spent T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:15:44.883730  8472 raft_consensus.cc:1275] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:44.884150  8472 pending_rounds.cc:85] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Aborting all ops after (but not including) 1
I20260709 12:15:44.884371  8472 pending_rounds.cc:107] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:44.884636  8472 raft_consensus.cc:2889] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:44.887915  9157 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.893226  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 330) took 2039 ms. Trace:
I20260709 12:15:44.847597  9093 consensus_queue.cc:237] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.894158  9358 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:44.893884  9124 consensus_queue.cc:237] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.866060  9388 consensus_queue.cc:1048] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:15:44.902544  9291 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:44.903803  9085 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.956823  9085 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:44.906243  9274 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.908983  9317 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:44.909832  9123 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.957448  8892 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:44.911242  9386 log.cc:927] Time spent T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:15:44.959610  9123 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:44.960513  8325 raft_consensus.cc:2393] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:44.902535  9191 raft_consensus.cc:3055] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:44.913314  9320 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:44.913578  9112 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:44.860641  9275 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.876355  9280 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:44.923094  8153 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37620 (request call id 75) took 5971 ms. Trace:
W20260709 12:15:44.947117  8370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.009s
I20260709 12:15:44.914479  8399 rpcz_store.cc:276] 0709 12:15:42.854060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:42.868865 (+ 14805us) service_pool.cc:224] Handling call
0709 12:15:43.706277 (+837412us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:44.310613 (+604336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:44.311332 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:44.892959 (+581627us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540027cc50. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:44.893154 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431617152}
I20260709 12:15:44.958791  8956 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:44.967905  8370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.004s	sys 0.009s
I20260709 12:15:44.894524  9113 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:44.973829  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 185928us
I20260709 12:15:44.932922  9161 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:44.980069  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 564090us
I20260709 12:15:44.979992  8527 raft_consensus.cc:359] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.991267  8527 raft_consensus.cc:385] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:44.915339  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 113708us
I20260709 12:15:44.992614  8370 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:45.009377  9112 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.009518  9275 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.010310  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:44.973270  9280 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.010977  8892 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:45.011875  9404 log.cc:927] Time spent T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:15:45.013751  8256 raft_consensus.cc:2393] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:45.014271  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 721048us
W20260709 12:15:44.954309  9249 consensus_meta.cc:287] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.000s
I20260709 12:15:45.027006  9249 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.029619  8405 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.019271  8370 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:44.991657  8527 raft_consensus.cc:740] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.031090  8527 consensus_queue.cc:260] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:44.966158  9191 raft_consensus.cc:740] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:45.021296  8324 raft_consensus.cc:1240] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:15:44.984651  8477 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:44.990612  9161 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:44.942955  9358 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:44.978586  9213 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.048221  8527 ts_tablet_manager.cc:1434] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.166s	user 0.003s	sys 0.007s
I20260709 12:15:45.021447  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:44.944504  9231 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.036130  9280 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.047019  8249 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:45.051492  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.062714  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.053398  9161 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.054977  9411 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.087568  8527 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: Bootstrap starting.
I20260709 12:15:45.087204  9411 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.090452  9411 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.035436  9323 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.056908  8443 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:44.966957  8153 rpcz_store.cc:276] 0709 12:15:38.935891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:38.986633 (+ 50742us) service_pool.cc:224] Handling call
0709 12:15:39.074974 (+ 88341us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54003e0b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e057090 00007f124e0f5f3a 00007f1253eabe9c 00007f1253faa04e 00007f125246b2a4 00007f125246b232 00007f125246b161 00007f125246b0dc 00007f125246a392 00007f124c42848c 00007f124c4278c6
0709 12:15:44.906962 (+5831988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:43.787059 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:43.787779 (+   720us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:43.787817 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:15:43.787837 (+    20us) tablet.cc:662] Decoding operations
0709 12:15:43.788280 (+   443us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:43.788343 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:43.788370 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:15:43.788741 (+   371us) tablet.cc:701] Row locks acquired
0709 12:15:43.788760 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:15:43.788895 (+   135us) write_op.cc:270] Start()
0709 12:15:43.789017 (+   122us) write_op.cc:276] Timestamp: P: 1783599343788850 usec, L: 0
0709 12:15:43.789055 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:15:43.789785 (+   730us) log.cc:844] Serialized 922 byte log entry
0709 12:15:44.239248 (+449463us) op_driver.cc:464] REPLICATION: finished
0709 12:15:44.341893 (+102645us) write_op.cc:301] APPLY: starting
0709 12:15:44.341990 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:44.342120 (+   130us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:44.342231 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:44.342632 (+   401us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:44.342839 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:15:44.342891 (+    52us) write_op.cc:312] APPLY: finished
0709 12:15:44.343134 (+   243us) log.cc:844] Serialized 28 byte log entry
0709 12:15:44.343321 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.343420 (+    99us) write_op.cc:454] Released schema lock
0709 12:15:44.343477 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:44.344331 (+   854us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:44.344361 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":974709,"reported_tablets":10,"spinlock_wait_cycles":61113216,"child_traces":[["op",{"apply.queue_time_us":102349,"apply.run_cpu_time_us":1986,"apply.run_wall_time_us":2409,"num_ops":2,"prepare.queue_time_us":196059,"prepare.run_cpu_time_us":34488,"prepare.run_wall_time_us":84730,"raft.queue_time_us":149190,"raft.run_cpu_time_us":25838,"raft.run_wall_time_us":105719,"replication_time_us":431816,"spinlock_wait_cycles":25472,"thread_start_us":394395,"threads_started":4,"wal-append.queue_time_us":202513}]]}
W20260709 12:15:45.037454  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 200091us
I20260709 12:15:45.101971  8221 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:45.050482  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 285725us
I20260709 12:15:45.103348  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:45.010847  8954 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:45.075421  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:45.075766  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:45.080312  9267 consensus_meta.cc:287] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.000s
W20260709 12:15:45.062748  9272 consensus_meta.cc:287] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.004s
I20260709 12:15:45.060633  9213 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.063444  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 251) took 1094 ms. Trace:
I20260709 12:15:45.083670  9129 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.122175  8474 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.122881  9118 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.119887  9323 raft_consensus.cc:697] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:45.124060  9129 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.020582  9031 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.124502  9323 consensus_queue.cc:237] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.126792  9031 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.107183  9191 consensus_queue.cc:260] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.084297  9358 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.128232  9191 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.128737  8954 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.131595  8248 raft_consensus.cc:2410] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:45.132561  8480 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:45.133270  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.134066  8399 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.134322  9231 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:45.109337  9406 log.cc:927] Time spent T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:45.136658  9320 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.111652  9289 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:45.138190  8527 tablet_bootstrap.cc:654] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:45.141289  9213 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.141399  9352 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.051204  8471 raft_consensus.cc:1217] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:15:45.046802  9245 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.063527  9157 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.091964  8252 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:45.068580  9342 consensus_meta.cc:287] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.001s
W20260709 12:15:45.112519  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 267785us
I20260709 12:15:45.106124  8296 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:45.106233  8222 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:45.117200  9267 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.118177  9274 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:45.145092  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.142481  9414 consensus_queue.cc:1059] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:45.146713  9272 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:45.146901  8478 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.152195  8471 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:45.112120  9324 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.156445  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.112921  9412 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:45.163265  9245 raft_consensus.cc:697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:45.114512  9121 consensus_queue.cc:1048] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
W20260709 12:15:45.166658  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 61253.7us
I20260709 12:15:45.167114  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.147068  9124 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.181746  9320 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.133313  9161 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.148620  9407 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:45.147640  9353 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.167742  9190 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.193585  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.130833  9286 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.157214  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 255) took 1094 ms. Trace:
W20260709 12:15:45.184023  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 77919.3us
I20260709 12:15:45.203426  8332 raft_consensus.cc:1240] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:45.196655  9412 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.168632  9342 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.247373  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.248127  8397 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.248313  8475 raft_consensus.cc:2393] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.249292  9342 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.162914  9157 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.209550  8222 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.203094  8399 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.184662  9022 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.197161  9324 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.229671  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.261751  8327 raft_consensus.cc:1240] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.263052  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.263991  8326 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.264696  9022 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.268311  9267 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.271106  9245 consensus_queue.cc:237] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.273061  9324 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.273799  9324 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.274286  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:45.229943  9206 consensus_meta.cc:287] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:15:45.232944  9234 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.233572  9161 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.234308  9190 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.235392  9286 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.236363  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 249) took 1341 ms. Trace:
I20260709 12:15:45.237210  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.197660  9031 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.245863  9412 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.250557  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 224) took 1083 ms. Trace:
W20260709 12:15:45.254900  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 45442.6us
I20260709 12:15:45.185698  9274 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.239130  9414 consensus_queue.cc:1048] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:15:45.184928  9355 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.276631  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.320058  8332 raft_consensus.cc:1275] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:45.252768  9157 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.302279  8331 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.305286  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.205907  9124 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.209385  8477 rpcz_store.cc:276] 0709 12:15:44.063273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.756185 (+692912us) service_pool.cc:224] Handling call
0709 12:15:44.839204 (+ 83019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.050951 (+211747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.156906 (+105955us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002c4cd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.157135 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285860736}
I20260709 12:15:45.310549  8402 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.318917  8222 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:45.209391  9320 raft_consensus.cc:697] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:45.274349  8400 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.275350  9235 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.324864  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.330327  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.204949  9353 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.320770  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.274302  9324 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.342077  8480 raft_consensus.cc:2393] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.321020  9356 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.331640  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.302793  9280 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.308125  9206 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.356712  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.207854  9407 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.321811  9031 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.356668  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.329919  9235 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.374464  8402 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.355611  8332 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.382191  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.383226  8257 raft_consensus.cc:2368] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:45.383365  8332 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.377923  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.379139  8405 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.328048  9289 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:45.389056  8404 raft_consensus.cc:2393] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.330449  9352 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.389528  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.396370  8402 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.377242  8329 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:45.395779  8330 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:45.429726  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.431859  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.435588  9353 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:45.396071  9423 log.cc:927] Time spent T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:15:45.405014  8332 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:45.320021  8475 rpcz_store.cc:276] 0709 12:15:44.167521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.312227 (+144706us) service_pool.cc:224] Handling call
0709 12:15:45.250291 (+938064us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54003061d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.250473 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932698496}
I20260709 12:15:45.408831  9411 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.386590  9235 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.407961  8402 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.410601  8527 tablet_bootstrap.cc:492] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: No bootstrap required, opened a new log
I20260709 12:15:45.429150  9274 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.359902  9356 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.309829  8473 rpcz_store.cc:276] 0709 12:15:43.895393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.512324 (+616931us) service_pool.cc:224] Handling call
0709 12:15:44.839972 (+327648us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:44.850364 (+ 10392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.874982 (+ 24618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.878319 (+  3337us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.955211 (+ 76892us) log.cc:844] Serialized 26 byte log entry
0709 12:15:45.037314 (+ 82103us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:45.048903 (+ 11589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.052030 (+  3127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:45.234757 (+182727us) raft_consensus.cc:1685] finished
0709 12:15:45.234777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:45.236287 (+  1510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":496,"raft.queue_time_us":11712,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4217,"spinlock_wait_cycles":3209088,"thread_start_us":74721,"threads_started":1,"wal-append.queue_time_us":238561}
I20260709 12:15:45.414630  8222 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:45.415656  9425 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:15:45.460655  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 46166.3us
I20260709 12:15:45.417232  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 252) took 1445 ms. Trace:
I20260709 12:15:45.417567  9031 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.418519  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 208) took 1297 ms. Trace:
I20260709 12:15:45.420595  8399 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
W20260709 12:15:45.422163  9424 log.cc:927] Time spent T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:15:45.422457  9206 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.377648  9417 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:45.357940  9025 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:15:45.453405  9411 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.472802  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.474866  9411 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:45.436908  9377 log.cc:927] Time spent T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:15:45.467021  9296 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:45.476243  9296 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.476781  9296 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.396864  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.452497  8527 ts_tablet_manager.cc:1403] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: Time spent bootstrapping tablet: real 0.365s	user 0.017s	sys 0.038s
I20260709 12:15:45.410846  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.481832  8405 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:45.452705  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.455974  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.482863  8402 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.464141  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.456197  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.466284  8249 rpcz_store.cc:276] 0709 12:15:44.121511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.344334 (+222823us) service_pool.cc:224] Handling call
0709 12:15:44.842086 (+497752us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:44.847517 (+  5431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.062596 (+215079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.418218 (+355622us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54004aae54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.418436 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414785152}
I20260709 12:15:45.469841  8406 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.488617  8257 raft_consensus.cc:2393] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:45.396960  9320 consensus_queue.cc:237] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.449688  8296 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:45.472862  9025 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:15:45.499490  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 49956.5us
I20260709 12:15:45.476275  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.500751  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:45.463742  8472 rpcz_store.cc:276] 0709 12:15:43.971709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.683884 (+712175us) service_pool.cc:224] Handling call
0709 12:15:44.747837 (+ 63953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:44.885127 (+137290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.416956 (+531829us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540023df54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.417164 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292542336}
I20260709 12:15:45.507129  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.507663  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.508360  8472 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.508437  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.502796  9206 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.509553  9206 raft_consensus.cc:697] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:45.495873  9025 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.507700  9411 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.487948  8398 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 1.
I20260709 12:15:45.511752  9025 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.512703  8970 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:45.512928  9025 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:45.513237  8970 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.497540  8475 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:45.514932  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.515586  8475 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:45.516515  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:45.516772  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.517110  8475 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:45.517371  9249 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.518105  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.520367  8222 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:45.521773  9417 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:15:45.524112  8478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 258) took 1311 ms (client timeout 1512 ms). Trace:
W20260709 12:15:45.524711  8478 rpcz_store.cc:269] 0709 12:15:44.212792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.231695 (+ 18903us) service_pool.cc:224] Handling call
0709 12:15:44.299730 (+ 68035us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:45.523857 (+1224127us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54008e4ed4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.524035 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850944512}
I20260709 12:15:45.526054  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.529080  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.510522  9206 consensus_queue.cc:237] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.533810  8220 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:45.542405  9324 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.538904  9249 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.538493  9417 consensus_queue.cc:1059] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:15:45.544026  9417 raft_consensus.cc:3055] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:45.544292  9356 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.544570  9417 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:45.545179  9430 log.cc:927] Time spent T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:45.536665  8445 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.549307  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:45.550763  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.551558  8478 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:45.552631  8527 raft_consensus.cc:359] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.553233  8527 raft_consensus.cc:385] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:45.538581  9355 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.555639  9422 raft_consensus.cc:2804] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:45.553494  8527 raft_consensus.cc:740] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Initialized, Role: FOLLOWER
I20260709 12:15:45.555076  8445 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.559677  8527 consensus_queue.cc:260] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.543497  9249 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.562566  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 320) took 1228 ms. Trace:
I20260709 12:15:45.563869  9249 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.545954  9417 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.565469  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 116) took 1183 ms. Trace:
I20260709 12:15:45.565877  8331 rpcz_store.cc:276] 0709 12:15:44.382160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.512134 (+129974us) service_pool.cc:224] Handling call
0709 12:15:44.512410 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.322876 (+810466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.565208 (+242332us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54008453d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.565403 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753969024}
I20260709 12:15:45.569770  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.605306  8445 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.606438  8445 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.573726  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.607383  8445 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.607997  8478 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:45.610298  8445 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.550064  9280 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.571908  8473 raft_consensus.cc:2410] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:45.541183  9031 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:45.613036  8527 ts_tablet_manager.cc:1434] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: Time spent starting tablet: real 0.132s	user 0.003s	sys 0.004s
I20260709 12:15:45.556595  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.573927  9093 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:45.616007  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:45.613729  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 76163.7us
W20260709 12:15:45.610196  9276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.023s
I20260709 12:15:45.558647  9342 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:45.619318  8478 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:45.573792  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.603546  9407 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.609473  9231 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.605306  9422 raft_consensus.cc:697] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.620739  9358 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.614319  9385 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.641592  9148 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.642395  9234 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.642200  9385 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.647847  9422 consensus_queue.cc:237] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.648554  9234 consensus_queue.cc:1059] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:45.649451  9234 raft_consensus.cc:3055] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:45.649852  9234 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.649511  9385 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.615643  9352 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.615168  8954 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.571594  8329 rpcz_store.cc:276] 0709 12:15:44.334278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.345134 (+ 10856us) service_pool.cc:224] Handling call
0709 12:15:44.510644 (+165510us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:45.562325 (+1051681us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400276354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.562495 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800434816}
I20260709 12:15:45.621627  9205 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:45.618906  9093 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.621001  8222 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:45.635907  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 220) took 1472 ms. Trace:
W20260709 12:15:45.639559  9391 log.cc:927] Time spent T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.965s	user 0.004s	sys 0.000s
I20260709 12:15:45.615110  9116 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.645834  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 247) took 1762 ms. Trace:
I20260709 12:15:45.634693  9358 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.646795  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 327) took 1259 ms. Trace:
I20260709 12:15:45.650727  9352 raft_consensus.cc:697] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:45.623801  9342 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.650682  9234 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.659945  9093 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.658305  8397 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.665215  8323 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:45.661449  8222 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:45.664162  8479 rpcz_store.cc:276] 0709 12:15:43.883278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.415640 (+532362us) service_pool.cc:224] Handling call
0709 12:15:44.695128 (+279488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.695858 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.645634 (+949776us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54006a31d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.645771 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616721664}
I20260709 12:15:45.647347  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:45.656893  9191 consensus_meta.cc:287] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.002s
I20260709 12:15:45.655035  8472 raft_consensus.cc:2468] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:45.660189  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.652693  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.664047  9289 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.666937  9358 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.663990  9022 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.681404  8330 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:45.620739  9276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.006s	sys 0.024s
I20260709 12:15:45.634301  9231 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.674664  9342 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.683467  8478 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:45.680030  9234 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.665880  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:45.687191  9389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.001s	sys 0.012s
I20260709 12:15:45.675357  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 200) took 1616 ms. Trace:
W20260709 12:15:45.698266  8297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.010s	sys 0.010s
I20260709 12:15:45.675243  9116 raft_consensus.cc:697] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:45.688508  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.662343  8954 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.703637  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 319) took 1369 ms. Trace:
I20260709 12:15:45.675530  8251 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:45.701499  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 218) took 1294 ms. Trace:
I20260709 12:15:45.715664  8330 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:45.716655  8256 rpcz_store.cc:276] 0709 12:15:44.406685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.579761 (+173076us) service_pool.cc:224] Handling call
0709 12:15:45.701290 (+1121529us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400269654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.701430 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782939008}
I20260709 12:15:45.717850  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.660652  8471 rpcz_store.cc:276] 0709 12:15:44.163338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.879533 (+716195us) service_pool.cc:224] Handling call
0709 12:15:44.906647 (+ 27114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:45.187134 (+280487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.629313 (+442179us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002eaed4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.635833 (+  6520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328290560}
I20260709 12:15:45.708516  8298 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:45.696806  8253 rpcz_store.cc:276] 0709 12:15:44.061593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.313509 (+251916us) service_pool.cc:224] Handling call
0709 12:15:44.313871 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:44.314280 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:44.314317 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:44.314868 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:15:44.539278 (+224410us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:44.541248 (+  1970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:44.543961 (+  2713us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:45.639021 (+1095060us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:45.674087 (+ 35066us) raft_consensus.cc:1685] finished
0709 12:15:45.674114 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:45.674954 (+   840us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":436,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":36757760,"thread_start_us":148910,"threads_started":1,"wal-append.queue_time_us":273578}
W20260709 12:15:45.709782  8297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.010s	sys 0.015s
I20260709 12:15:45.691387  8445 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.677559  9235 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.711086  8479 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:45.710733  9336 consensus_meta.cc:287] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.000s
I20260709 12:15:45.687752  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.683130  9031 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.677886  9412 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.690871  8477 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.685768  8326 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.716486  8325 rpcz_store.cc:276] 0709 12:15:44.333875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.357328 (+ 23453us) service_pool.cc:224] Handling call
0709 12:15:45.703419 (+1346091us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400275e54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.703572 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988400000}
I20260709 12:15:45.721719  9383 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:45.723028  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 1.29764e+06us
I20260709 12:15:45.723940  8220 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:45.724181  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.724709  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.740945  8297 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:45.741653  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.728317  8402 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.742690  8332 raft_consensus.cc:2393] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:45.673300  8327 rpcz_store.cc:276] 0709 12:15:44.387751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.583419 (+195668us) service_pool.cc:224] Handling call
0709 12:15:44.583744 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.262308 (+678564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.646542 (+384234us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54005b7554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.646732 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506462976}
I20260709 12:15:45.711440  9206 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:45.717204  9022 raft_consensus.cc:697] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.691180  9289 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.720234  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.737779  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.752519  8479 raft_consensus.cc:3060] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.730888  9436 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.753266  8402 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.745322  9383 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.746032  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.755259  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 220) took 1068 ms. Trace:
I20260709 12:15:45.684314  9352 consensus_queue.cc:237] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.747396  9272 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:45.755764  8248 rpcz_store.cc:276] 0709 12:15:44.686499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.698119 (+ 11620us) service_pool.cc:224] Handling call
0709 12:15:45.755052 (+1056933us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540026b954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:45.755198 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655052160}
I20260709 12:15:45.756484  9272 raft_consensus.cc:697] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.756385  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.756922  9412 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.757803  8249 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:45.747771  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.747886  8372 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:45.757645  9272 consensus_queue.cc:237] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.759732  9249 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:45.734095  9336 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.760897  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.759361  9022 consensus_queue.cc:237] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.730249  9031 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:45.738919  9324 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.750905  9355 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.753799  9206 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:45.715562  9389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.001s	sys 0.012s
I20260709 12:15:45.736922  9116 consensus_queue.cc:237] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.792420  8954 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.792833  8324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 332) took 1136 ms. Trace:
I20260709 12:15:45.793269  8324 rpcz_store.cc:276] 0709 12:15:44.656356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.009523 (+353167us) service_pool.cc:224] Handling call
0709 12:15:45.009920 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:45.050424 (+ 40504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.769050 (+718626us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b54003b1354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.792764 (+ 23714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8163072}
I20260709 12:15:45.119690  8476 rpcz_store.cc:276] 0709 12:15:43.967925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.513251 (+545326us) service_pool.cc:224] Handling call
0709 12:15:44.539884 (+ 26633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:44.579800 (+ 39916us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:44.662820 (+ 83020us) log.cc:844] Serialized 14 byte log entry
0709 12:15:44.697355 (+ 34535us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003965e0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d23a 00007f124e0f7a2a
0709 12:15:45.023391 (+326036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:45.043926 (+ 20535us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:45.047695 (+  3769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.051420 (+  3725us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:45.062295 (+ 10875us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87685,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":112,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":24972928,"thread_start_us":315110,"threads_started":1,"wal-append.queue_time_us":526519}
I20260709 12:15:45.749971  9417 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.764840  8332 raft_consensus.cc:1275] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.797086  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.798084  9289 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:45.761626  8399 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 1.
I20260709 12:15:45.799400  9411 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:45.799736  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.801131  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.781759  9324 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.802107  8399 raft_consensus.cc:2393] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:45.767117  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.745227  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.809000  8474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 254) took 1809 ms. Trace:
I20260709 12:15:45.798132  8252 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:45.809552  8474 rpcz_store.cc:276] 0709 12:15:43.999299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.694042 (+694743us) service_pool.cc:224] Handling call
0709 12:15:44.694340 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.122689 (+428349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.808706 (+686017us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54001879d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:45.808923 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953851648}
I20260709 12:15:45.810429  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.803779  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:45.737617  9432 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:15:45.736464  8473 raft_consensus.cc:2368] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:45.761168  9249 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:45.764199  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:45.773007  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:45.765945  8222 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:45.768783  9031 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:45.784889  9336 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:45.787348  8398 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:45.787976  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.755332  9383 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:45.844702  8479 raft_consensus.cc:2468] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
W20260709 12:15:45.790825  9437 log.cc:927] Time spent T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:45.791805  9355 raft_consensus.cc:697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:45.814459  8478 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:45.819628  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.803787  8471 raft_consensus.cc:2393] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.823503  9411 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:45.811581  9435 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:15:45.829859  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 64041.1us
I20260709 12:15:45.824239  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.815522  9296 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.803709  9324 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.781136  9286 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:45.894505  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.855346  8332 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:45.780450  9436 raft_consensus.cc:697] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:45.859776  9336 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:45.860248  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.865520  8297 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:45.927739  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 62342.7us
I20260709 12:15:45.928196  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.928431  8297 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:45.928900  8332 raft_consensus.cc:2368] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:45.871879  9231 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.824999  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:45.884163  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 155376us
I20260709 12:15:45.842799  9289 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:45.892827  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.893990  9249 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.896726  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:45.899494  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.900040  9124 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.900363  8325 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:15:45.902861  9358 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.903672  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:45.904062  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.913317  9411 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.905539  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:45.906946  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.907088  8476 raft_consensus.cc:1240] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:45.969055  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 222) took 1805 ms. Trace:
I20260709 12:15:45.907640  9355 consensus_queue.cc:237] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:45.969501  8476 rpcz_store.cc:276] 0709 12:15:44.163686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.813772 (+1650086us) service_pool.cc:224] Handling call
0709 12:15:45.884564 (+ 70792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.968706 (+ 84142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.968980 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:45.907122  8256 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:45.830736  9161 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:15:45.971916  9235 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:45.855451  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.974438  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.976075  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.812686  9205 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:45.977118  9205 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:45.909183  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:45.854792  9356 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:45.979347  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.979703  9356 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.980187  8250 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:45.981400  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.929669  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.931599  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 184) took 1797 ms. Trace:
I20260709 12:15:45.911046  8298 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:45.934418  9129 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:45.984350  9129 consensus_queue.cc:1059] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.959195  8403 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.904657  8477 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:45.950546  8248 raft_consensus.cc:2368] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:45.937263  9393 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:45.953085  8474 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:45.961512  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:45.924358  9286 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.931092  9336 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:45.968469  9436 consensus_queue.cc:237] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:45.987854  8296 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:45.982868  8255 rpcz_store.cc:276] 0709 12:15:44.133791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:44.359092 (+225301us) service_pool.cc:224] Handling call
0709 12:15:44.440365 (+ 81273us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:45.539713 (+1099348us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:45.539925 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:45.540264 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:45.540308 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:45.553746 (+ 13438us) log.cc:844] Serialized 26 byte log entry
0709 12:15:45.618140 (+ 64394us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:45.618167 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:45.618225 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:45.931385 (+313160us) raft_consensus.cc:1685] finished
0709 12:15:45.931411 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:45.931539 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50169600,"thread_start_us":52481,"threads_started":1,"wal-append.queue_time_us":115312}
I20260709 12:15:45.969513  9299 raft_consensus.cc:3055] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:46.014472  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:45.985499  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:45.979410  8480 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:45.949514  9289 raft_consensus.cc:697] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:45.982180  9356 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:45.926581  9093 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:45.964010  8398 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:45.935868  8970 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.005779  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:46.034421  8248 raft_consensus.cc:2410] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:46.034693  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.035483  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:46.035732  8250 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:46.036188  8398 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:46.037144  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:46.038514  8398 raft_consensus.cc:1240] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:45.970840  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.039237  8476 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:46.039450  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.040515  8476 raft_consensus.cc:1240] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:46.040809  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.035504  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.042033  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:45.926898  8323 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:45.995560  9393 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.000772  9320 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.022310  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:46.001124  9124 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:46.020308  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:46.024890  8325 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.033442  8257 raft_consensus.cc:1240] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:46.015725  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:46.012220  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 227) took 1817 ms. Trace:
I20260709 12:15:46.080749  8372 leader_election.cc:400] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:46.099260  8480 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:46.018532  9299 raft_consensus.cc:740] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:46.088636  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.020817  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.103716  8221 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:46.104840  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.105000  8480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 263) took 1337 ms. Trace:
I20260709 12:15:46.088588  9124 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:46.099485  8372 leader_election.cc:403] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:46.089344  9235 consensus_queue.cc:1059] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.085250  9393 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.031881  8251 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:46.081574  9190 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:46.081641  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.079734  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 262) took 1609 ms. Trace:
I20260709 12:15:46.087775  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:46.159318  8479 raft_consensus.cc:1240] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:46.107810  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.108165  9022 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.107618  9356 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.105923  8480 rpcz_store.cc:276] 0709 12:15:44.767590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.097283 (+1329693us) service_pool.cc:224] Handling call
0709 12:15:46.099018 (+  1735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.104580 (+  5562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.104909 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.126322  9355 raft_consensus.cc:2764] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:15:46.133126  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 222197us
I20260709 12:15:46.097584  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.100262  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.046113  9205 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.198423  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:46.139317  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:46.199329  8397 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:46.200266  9286 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.083038  9414 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:15:46.201997  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:46.093639  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 163942us
W20260709 12:15:46.203153  9449 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:15:46.203100  8297 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.203504  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.204754  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.204932  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.205753  8323 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:46.105878  9296 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.160246  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 123) took 1098 ms. Trace:
I20260709 12:15:46.198477  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.207731  8479 rpcz_store.cc:276] 0709 12:15:45.061963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.158702 (+1096739us) service_pool.cc:224] Handling call
0709 12:15:46.159079 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.159895 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.160171 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.209158  8329 raft_consensus.cc:1240] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:46.209657  8479 raft_consensus.cc:1240] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:46.210479  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 124) took 1146 ms. Trace:
I20260709 12:15:46.124621  8475 raft_consensus.cc:2368] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:46.109601  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:46.188053  8369 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:46.133356  9450 raft_consensus.cc:3055] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:46.165066  8252 raft_consensus.cc:2393] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:46.185341  8250 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:15:46.195271  9442 log.cc:927] Time spent T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:15:46.195891  9355 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:46.181798  9022 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.197470  8253 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:46.105628  9272 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:46.207685  9445 log.cc:927] Time spent T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:46.162066  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:46.210856  8479 rpcz_store.cc:276] 0709 12:15:45.063897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.209003 (+1145106us) service_pool.cc:224] Handling call
0709 12:15:46.209395 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.210196 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.210415 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.159695  9161 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.225080  8405 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:46.185645  9416 log.cc:927] Time spent T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.877s	user 0.000s	sys 0.005s
I20260709 12:15:46.123571  9190 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:46.264772  9161 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.240695  9411 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.268383  9124 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:46.268517  9411 raft_consensus.cc:2749] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.099339  8472 rpcz_store.cc:276] 0709 12:15:44.195331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.857129 (+1661798us) service_pool.cc:224] Handling call
0709 12:15:45.930943 (+ 73814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.957873 (+ 26930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:45.959448 (+  1575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:45.965395 (+  5947us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:45.991709 (+ 26314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.002654 (+ 10945us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.012147 (+  9493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.268752  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.269330  9411 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.225983  9324 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:46.244552  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 256760us
I20260709 12:15:46.184578  9206 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:46.137226  9383 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:46.254536  8248 raft_consensus.cc:1275] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.262276  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.258839  9296 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:46.243223  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 55263.6us
I20260709 12:15:46.225561  9450 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:46.284082  8296 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:46.244534  9245 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:46.283690  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 119112us
I20260709 12:15:46.266789  9190 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:46.133126  9289 consensus_queue.cc:237] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.311561  8332 raft_consensus.cc:2368] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:46.243765  8323 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:46.135726  8476 rpcz_store.cc:276] 0709 12:15:44.432269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.039983 (+1607714us) service_pool.cc:224] Handling call
0709 12:15:46.040307 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.040913 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.041142 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:46.292511  8445 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:46.251837  9022 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.255419  9407 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.256188  9358 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.261574  9272 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.295895  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.307471  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.264444  9093 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.307934  8404 raft_consensus.cc:1275] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:46.286782  9446 log.cc:927] Time spent T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:15:46.286360  9414 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.319231  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.315537  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.323484  8443 leader_election.cc:400] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:46.352042  8443 leader_election.cc:403] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:15:46.305500  9206 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:46.255203  9355 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:46.354296  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 58466.4us
I20260709 12:15:46.355571  8296 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:46.289222  9161 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.358218  8446 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:46.318053  9336 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.291198  9324 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:46.371483  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 61516.9us
I20260709 12:15:46.381588  8443 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.338472  9352 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:46.389213  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:46.396003  8443 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.359579  8446 leader_election.cc:400] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
W20260709 12:15:46.378206  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 188320us
W20260709 12:15:46.406329  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 46872.4us
I20260709 12:15:46.406478  8298 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:46.302714  9296 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.342375  9272 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:46.419723  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.307973  9245 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.344700  9407 raft_consensus.cc:697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:46.349479  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:46.463241  8404 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:46.371937  9190 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.412799  9274 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:46.372664  9456 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.416067  9093 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.411420  9352 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.372264  9454 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:46.416766  9226 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:46.411753  9336 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:46.411988  8400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 259) took 1252 ms. Trace:
I20260709 12:15:46.488782  8404 raft_consensus.cc:1275] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:46.422402  9231 consensus_queue.cc:1059] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
W20260709 12:15:46.510013  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:46.410198  9320 consensus_queue.cc:1059] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 12:15:46.371471  9414 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.192175  9299 consensus_queue.cc:260] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.504176  9352 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.479619  9124 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:46.467211  9116 consensus_queue.cc:1048] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:15:46.486903  9456 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.460016  9161 consensus_queue.cc:1059] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:15:46.505412  9274 raft_consensus.cc:697] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:46.534062  8404 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:15:46.550424  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 167432us
I20260709 12:15:46.383478  9450 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.516654  9235 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.537374  9454 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:46.542862  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.560145  8443 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:46.554595  9342 consensus_meta.cc:287] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.844s	user 0.014s	sys 0.000s
I20260709 12:15:46.533716  9358 consensus_queue.cc:1059] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:15:46.553442  9093 raft_consensus.cc:3055] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:46.532501  9336 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.555794  9456 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.615708  8406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 352) took 1284 ms. Trace:
I20260709 12:15:46.616183  8406 rpcz_store.cc:276] 0709 12:15:45.331771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.334569 (+  2798us) service_pool.cc:224] Handling call
0709 12:15:45.469653 (+135084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:45.488433 (+ 18780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.615452 (+1127019us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540032aad0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:46.615641 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310029568}
I20260709 12:15:46.584359  9450 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:46.632279  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 46929.3us
I20260709 12:15:46.635751  8478 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:46.639560  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 228) took 2441 ms. Trace:
I20260709 12:15:46.640139  8478 rpcz_store.cc:276] 0709 12:15:44.198563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.856096 (+1657533us) service_pool.cc:224] Handling call
0709 12:15:46.635155 (+779059us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:46.635457 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.639284 (+  3827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.639500 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35370752}
I20260709 12:15:46.583405  9124 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:46.624502  9031 consensus_meta.cc:287] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.001s
I20260709 12:15:46.515753  8400 rpcz_store.cc:276] 0709 12:15:45.159747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.161492 (+  1745us) service_pool.cc:224] Handling call
0709 12:15:46.356751 (+1195259us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54005c4ed4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:46.378059 (+ 21308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117750656}
I20260709 12:15:46.592885  9093 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:46.572680  9235 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.594996  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.654444  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 270) took 1174 ms. Trace:
I20260709 12:15:46.637873  9320 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:46.659991  9355 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:46.647758  9458 log.cc:927] Time spent T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:15:46.594116  9383 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.645714  9161 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.593329  9342 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.687235  9413 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:46.598361  9389 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:46.706645  9389 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.707224  9093 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:46.709400  9389 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:46.568674  9407 consensus_queue.cc:237] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.711252  9245 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.693688  9320 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:46.712565  9235 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:46.663898  9459 log.cc:927] Time spent T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:15:46.714026  9320 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:46.695420  9249 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.714818  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 130) took 1230 ms. Trace:
I20260709 12:15:46.690377  9116 consensus_queue.cc:1059] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:46.715143  9249 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.715292  8473 rpcz_store.cc:276] 0709 12:15:45.484725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.633456 (+148731us) service_pool.cc:224] Handling call
0709 12:15:46.714606 (+1081150us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54002f3854. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:46.714755 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50620288}
I20260709 12:15:46.716704  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.717401  9249 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:46.717577  9356 consensus_meta.cc:287] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:15:46.718096  9356 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:46.718122  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.664809  9473 raft_consensus.cc:3055] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:46.718758  9413 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.719218  9473 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:46.719700  8474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 223) took 2552 ms. Trace:
I20260709 12:15:46.720126  8474 rpcz_store.cc:276] 0709 12:15:44.167194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.810647 (+1643453us) service_pool.cc:224] Handling call
0709 12:15:45.815971 (+  5324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.007784 (+191813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.719455 (+711671us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54006a2f54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:46.719639 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282390912}
I20260709 12:15:46.720219  9473 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.721573  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.721805  9473 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:46.721987  8398 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:46.690418  8472 rpcz_store.cc:276] 0709 12:15:45.479875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.269340 (+789465us) service_pool.cc:224] Handling call
0709 12:15:46.269669 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.269891 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:46.270196 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 12:15:46.597021 (+326825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:46.614587 (+ 17566us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:46.629229 (+ 14642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.637722 (+  8493us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.650099 (+ 12377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10891,"prepare.queue_time_us":11968,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":55731,"spinlock_wait_cycles":18866688,"thread_start_us":242867,"threads_started":2,"wal-append.queue_time_us":263348}
I20260709 12:15:46.723251  9324 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:46.724238  9462 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:15:46.724402  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.725060  8330 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:46.704094  9476 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:15:46.724249  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.720986  9413 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:46.727465  8472 raft_consensus.cc:2393] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:46.728425  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 266) took 1609 ms. Trace:
I20260709 12:15:46.728977  8479 rpcz_store.cc:276] 0709 12:15:45.118937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.259929 (+1140992us) service_pool.cc:224] Handling call
0709 12:15:46.260295 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.260669 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.260697 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:46.282909 (+ 22212us) log.cc:844] Serialized 26 byte log entry
0709 12:15:46.460441 (+177532us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:46.460490 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.460565 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:46.728196 (+267631us) raft_consensus.cc:1685] finished
0709 12:15:46.728220 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.728366 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":639,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":168732,"threads_started":1,"wal-append.queue_time_us":362731}
I20260709 12:15:46.739949  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.745615  8445 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.657636  9031 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.722879  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.726384  9414 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.751376  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 240) took 1207 ms. Trace:
I20260709 12:15:46.749032  8330 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:46.703760  9161 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.693274  9274 consensus_queue.cc:237] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:46.750192  9465 log.cc:927] Time spent T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:15:46.831370  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:46.751237  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 292925us
I20260709 12:15:46.831983  8478 rpcz_store.cc:276] 0709 12:15:45.544486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.645311 (+1100825us) service_pool.cc:224] Handling call
0709 12:15:46.669225 (+ 23914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.669528 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:46.696170 (+ 26642us) log.cc:844] Serialized 14 byte log entry
0709 12:15:46.751010 (+ 54840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:46.751068 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:46.751110 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.751182 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:46.751317 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26177,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":62,"raft.queue_time_us":1802,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15614,"thread_start_us":54354,"threads_started":1}
I20260709 12:15:46.793453  8370 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:46.750300  8325 consensus_meta.cc:287] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
W20260709 12:15:46.783967  9467 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
W20260709 12:15:46.894361  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 101620us
I20260709 12:15:46.836385  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:46.771167  9464 log.cc:927] Time spent T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:15:46.796361  9393 consensus_meta.cc:287] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.000s
I20260709 12:15:46.784718  9342 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.745874  9355 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:15:46.906641  9336 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.907836  8445 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:46.770706  8471 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:46.912036  8370 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:46.972447  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 60504.9us
I20260709 12:15:46.973250  8370 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.750379  9483 raft_consensus.cc:3055] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:46.787063  9480 raft_consensus.cc:3055] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:46.770509  9478 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:46.812755  9476 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:46.977217  8370 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.907971  9407 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:46.924929  9457 log.cc:927] Time spent T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.575s	user 0.001s	sys 0.001s
W20260709 12:15:46.925823  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 142) took 1363 ms (client timeout 1608 ms). Trace:
W20260709 12:15:46.926386  9490 log.cc:927] Time spent T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:15:46.983393  9489 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:46.927232  8298 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:46.983777  8256 rpcz_store.cc:269] 0709 12:15:45.562935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.717633 (+154698us) service_pool.cc:224] Handling call
0709 12:15:46.925630 (+1207997us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400699454. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:46.925752 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433642752}
W20260709 12:15:46.987283  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 60142us
I20260709 12:15:46.986958  9489 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:46.988148  8298 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:46.928367  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:46.989568  9489 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:46.974803  9116 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:46.928879  8372 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.832278  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.994284  9468 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:46.998906  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 70070.3us
I20260709 12:15:46.978930  9336 raft_consensus.cc:3055] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:46.913800  8446 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:46.980685  8370 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:46.922652  9022 consensus_meta.cc:287] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 12:15:46.982383  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.997953  9468 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.013181  9468 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:47.013370  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 99642.9us
I20260709 12:15:47.014182  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:47.014448  8970 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.015247  9190 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.015873  8446 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:47.016029  9190 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:47.016557  9190 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:46.996361  9116 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.016969  9190 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.017132  9116 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.017386  8446 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:47.018575  9231 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:46.986268  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.019932  9231 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:47.020022  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.020720  8405 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.020607  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.022013  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.023357  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.024137  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.024842  8248 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:47.026250  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:46.989876  8330 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:46.918125  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:46.803913  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:46.920643  9296 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:46.920010  9031 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:46.787113  9456 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:46.921409  9161 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:46.970971  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 63264.8us
I20260709 12:15:46.976869  9478 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:46.993049  8325 raft_consensus.cc:2410] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:46.979161  9245 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:47.028710  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 48146.6us
I20260709 12:15:46.977298  9483 raft_consensus.cc:740] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:47.029453  8478 raft_consensus.cc:2393] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:46.984665  9389 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.031137  8220 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:46.977142  9480 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:46.798221  9272 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:46.984333  9482 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:46.972127  9393 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.059639  9480 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:47.061333  9480 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.061836  9456 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.045676  9478 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:46.918968  9352 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.063401  8324 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:47.064225  8255 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:47.020520  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.010468  9481 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:46.983861  9476 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.045284  8330 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:47.011165  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.026304  8248 raft_consensus.cc:1275] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:47.010974  9336 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:47.047156  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.046794  8370 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:47.047104  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:47.073627  8406 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:47.074060  8478 raft_consensus.cc:1275] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:47.074156  8331 raft_consensus.cc:2468] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:47.028719  9489 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:47.033365  9324 raft_consensus.cc:2804] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:47.050892  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.057937  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.057752  9389 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:47.058533  8473 raft_consensus.cc:1240] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:47.058727  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:47.032177  9022 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:47.087507  8369 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:47.048141  9245 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:47.061837  9393 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:46.995247  9487 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:47.007509  9407 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.090876  9324 raft_consensus.cc:697] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:47.095211  8403 raft_consensus.cc:1275] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.094919  9324 consensus_queue.cc:237] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.040506  9485 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.098511  9485 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.100739  9485 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.100773  9389 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:47.041450  8405 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:47.072136  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:47.101440  9190 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.101794  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 241) took 1116 ms. Trace:
I20260709 12:15:47.102018  8330 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.103600  9190 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.104487  9161 raft_consensus.cc:2804] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:47.105018  9161 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:47.105232  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.106032  8472 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:47.105935  9116 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.107585  9336 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.074759  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 133) took 1410 ms. Trace:
I20260709 12:15:47.105042  9190 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.076066  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:47.076668  8370 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:47.108839  9336 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.109499  9356 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:47.109890  9356 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:47.110015  8370 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:47.110297  9356 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.111295  8370 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:47.113121  8324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 269) took 1249 ms. Trace:
I20260709 12:15:47.081322  8404 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.114107  9470 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.116127  8402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 190) took 1350 ms. Trace:
I20260709 12:15:47.116751  9022 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:47.117039  8256 raft_consensus.cc:1240] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:47.116525  8402 rpcz_store.cc:276] 0709 12:15:45.766025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.766156 (+   131us) service_pool.cc:224] Handling call
0709 12:15:46.371795 (+605639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.372021 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:46.462842 (+ 90821us) log.cc:844] Serialized 14 byte log entry
0709 12:15:46.644099 (+181257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:46.644176 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:46.644239 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.644336 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.115951 (+471615us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54005c4ed0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.116063 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49207,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3883,"raft.queue_time_us":174484,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8341,"spinlock_wait_cycles":1392042368,"thread_start_us":180786,"threads_started":2,"wal-append.queue_time_us":261951}
I20260709 12:15:47.070174  9025 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:47.118702  8327 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:47.102299  8473 rpcz_store.cc:276] 0709 12:15:45.985127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.057866 (+1072739us) service_pool.cc:224] Handling call
0709 12:15:47.058263 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.090610 (+ 32347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.101724 (+ 11114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.082360  8400 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:47.120502  8473 raft_consensus.cc:1275] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:47.120604  8327 raft_consensus.cc:1275] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:47.120988  8327 pending_rounds.cc:85] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 1
I20260709 12:15:47.121244  8327 pending_rounds.cc:107] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:47.121516  8327 raft_consensus.cc:2889] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:47.122016  8473 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:47.070300  9296 consensus_queue.cc:1059] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:15:47.082628  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.123378  8474 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.124637  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:47.125379  9129 consensus_queue.cc:1059] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.125663  8404 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:47.126313  9129 consensus_queue.cc:1048] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:47.079927  9482 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:47.127085  9417 raft_consensus.cc:3055] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:47.127179  9482 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:47.127581  9417 raft_consensus.cc:740] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.083104  9342 consensus_queue.cc:1048] T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.127663  9482 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.076053  9422 consensus_queue.cc:1059] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:15:47.128474  9417 consensus_queue.cc:260] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.089028  9245 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.129515  9417 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.108744  8478 rpcz_store.cc:276] 0709 12:15:45.664513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.056403 (+1391890us) service_pool.cc:224] Handling call
0709 12:15:47.071337 (+ 14934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.074498 (+  3161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.074704 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.072983  8476 raft_consensus.cc:1240] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:47.090512  9487 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:47.131546  9487 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.132973  9356 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.072947  9355 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.135445  8330 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:47.135241  9355 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.137621  8330 raft_consensus.cc:1275] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.105466  9161 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.108243  9116 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.113220  9407 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:15:47.125485  8328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 124) took 1401 ms (client timeout 1644 ms). Trace:
W20260709 12:15:47.126516  8332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 261) took 1265 ms (client timeout 1630 ms). Trace:
W20260709 12:15:47.066323  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.138942  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 92882.3us
I20260709 12:15:47.091900  9205 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.045455  9231 consensus_queue.cc:1048] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:15:47.074841  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.127767  9129 raft_consensus.cc:3055] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:47.191676  8406 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
W20260709 12:15:47.145593  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:47.176646  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 103809us
W20260709 12:15:47.181097  8332 rpcz_store.cc:269] 0709 12:15:45.861471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.929439 (+ 67968us) service_pool.cc:224] Handling call
0709 12:15:47.126327 (+1196888us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54005b7054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.126445 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754787712}
I20260709 12:15:47.193121  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.172550  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 262) took 1286 ms. Trace:
I20260709 12:15:47.212383  9245 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.181468  9025 raft_consensus.cc:697] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.214010  9025 consensus_queue.cc:237] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:47.180776  8328 rpcz_store.cc:269] 0709 12:15:45.724071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.724695 (+   624us) service_pool.cc:224] Handling call
0709 12:15:47.124444 (+1399749us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:47.125414 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4167040}
I20260709 12:15:47.113804  8324 rpcz_store.cc:276] 0709 12:15:45.863962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.975757 (+111795us) service_pool.cc:224] Handling call
0709 12:15:47.112914 (+1137157us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54007c9cd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.113055 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498248064}
I20260709 12:15:47.215958  9286 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:47.216615  9286 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:47.098855  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:47.219651  8253 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:47.221599  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.180823  9475 consensus_queue.cc:1059] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:15:47.222913  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.223867  9286 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:47.205581  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.224445  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.225191  8251 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:47.225260  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.225915  8248 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:47.209319  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.226157  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.226836  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.227068  8402 raft_consensus.cc:1275] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.227286  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.224117  9272 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.181277  9110 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:47.191512  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.228109  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.228417  8402 raft_consensus.cc:1275] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:47.228989  8472 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:47.098882  8326 raft_consensus.cc:1240] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:47.116751  9476 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.227445  8248 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:47.109144  9190 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.174597  8323 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:47.240993  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.241501  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:47.242070  9190 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.106033  8254 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 6.
I20260709 12:15:47.242256  8324 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:47.243291  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:47.243650  8248 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:47.244076  9422 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.244608  9422 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.230335  8298 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:47.247167  9383 raft_consensus.cc:2749] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:47.247434  8222 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:47.246714  8298 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:47.248557  9110 raft_consensus.cc:697] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.249339  8298 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:47.080482  9489 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.230657  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.248626  9320 raft_consensus.cc:2764] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:15:47.240689  9296 raft_consensus.cc:3055] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:47.246644  9422 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.239188  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.271200  8406 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.205757  9129 raft_consensus.cc:740] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:47.214877  9245 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.230160  9352 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:47.290320  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 118983us
W20260709 12:15:47.291234  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.291939  9190 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.292519  9190 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.292953  9205 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.295188  9205 consensus_queue.cc:1048] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:47.250880  9356 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.259138  9485 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:47.315726  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 120392us
I20260709 12:15:47.329656  8370 leader_election.cc:400] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 1. Current term is 2.
I20260709 12:15:47.258651  8970 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:47.257143  9414 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:47.326161  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.330871  8370 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:47.250823  9407 consensus_queue.cc:1059] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:15:47.261708  9296 raft_consensus.cc:740] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.334794  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 231) took 2001 ms. Trace:
I20260709 12:15:47.177613  9483 consensus_queue.cc:260] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.257057  9272 consensus_queue.cc:1059] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:15:47.284973  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.262192  9383 consensus_queue.cc:1048] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:15:47.339552  8370 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:47.275741  8326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 351) took 1365 ms. Trace:
I20260709 12:15:47.322186  8406 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:47.274372  9206 consensus_queue.cc:1059] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 12:15:47.368134  9190 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.376945  8399 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:47.249632  9110 consensus_queue.cc:237] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.211942  8329 rpcz_store.cc:276] 0709 12:15:45.861812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.212682 (+350870us) service_pool.cc:224] Handling call
0709 12:15:46.213005 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.213236 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:46.377122 (+163886us) log.cc:844] Serialized 14 byte log entry
0709 12:15:46.781072 (+403950us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b18003b4c40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:15:47.110360 (+329288us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b18003b4c40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287
0709 12:15:47.110633 (+   273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:47.110702 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:47.110754 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.110852 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.148312 (+ 37460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36463,"prepare.queue_time_us":379340,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":140174,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6640,"spinlock_wait_cycles":59898240,"thread_start_us":479263,"threads_started":3,"wal-append.queue_time_us":262639}
I20260709 12:15:47.379330  9299 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.380174  9355 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.331846  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:47.388341  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 48878us
I20260709 12:15:47.338939  9356 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.348014  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:47.376535  9249 consensus_queue.cc:1175] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35617b9c10ad4daa80878f0de881422c" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:47.394632  9356 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.402801  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 237) took 1898 ms. Trace:
I20260709 12:15:47.329851  9478 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.333997  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:47.409771  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 144942us
I20260709 12:15:47.388137  9206 consensus_queue.cc:1243] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer 29d436e9d3d54fe599d9aa67d38fba03 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
W20260709 12:15:47.410880  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.348560  9414 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:47.414019  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 166660us
W20260709 12:15:47.390328  8475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 131) took 1872 ms (client timeout 1722 ms). Trace:
I20260709 12:15:47.403335  8476 rpcz_store.cc:276] 0709 12:15:45.504610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.343350 (+838740us) service_pool.cc:224] Handling call
0709 12:15:46.461167 (+117817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.131249 (+670082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.402518 (+271269us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400133154. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:47.402730 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378875648}
I20260709 12:15:47.427421  8220 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:47.445910  8222 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:47.372426  8249 rpcz_store.cc:276] 0709 12:15:45.329867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.508184 (+178317us) service_pool.cc:224] Handling call
0709 12:15:47.311077 (+1802893us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400515754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.331289 (+ 20212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524779264}
I20260709 12:15:47.373643  8326 rpcz_store.cc:276] 0709 12:15:45.910624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.098280 (+1187656us) service_pool.cc:224] Handling call
0709 12:15:47.098670 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.239830 (+141160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.271328 (+ 31498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:47.408964  9407 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:47.451395  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.410825  9324 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:47.445345  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.373951  9129 consensus_queue.cc:260] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:47.487917  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.517757  9495 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.468938  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.524066  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:47.584244  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.524986  8445 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:47.589006  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 64096.5us
I20260709 12:15:47.589920  8445 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:47.544603  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.418728  9356 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:47.418728  9505 raft_consensus.cc:3055] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:47.594375  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.595165  8480 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.543074  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 350) took 1633 ms. Trace:
I20260709 12:15:47.596563  8331 rpcz_store.cc:276] 0709 12:15:45.910032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.086795 (+1176763us) service_pool.cc:224] Handling call
0709 12:15:47.541544 (+454749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.541771 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.541798 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:47.541846 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:47.541879 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.541937 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.542865 (+   928us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540032c3d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.543007 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044641664}
I20260709 12:15:47.418856  9487 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.447649  9475 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:47.466230  8970 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:47.515911  8473 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:47.522683  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.413318  9296 consensus_queue.cc:260] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.522147  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:47.537569  9463 log.cc:927] Time spent T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.998s	user 0.000s	sys 0.004s
W20260709 12:15:47.526670  9503 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:15:47.518173  8472 raft_consensus.cc:2393] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:47.464112  9422 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:47.655406  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 55723.9us
W20260709 12:15:47.547502  9502 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:15:47.587975  9468 consensus_meta.cc:287] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 12:15:47.523401  9129 raft_consensus.cc:3060] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.553488  9470 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:47.528095  9324 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.750555  9324 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.659482  9514 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:47.753177  9324 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:47.539932  8323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 277) took 1163 ms (client timeout 1543 ms). Trace:
W20260709 12:15:47.754726  8323 rpcz_store.cc:269] 0709 12:15:46.376568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.469571 (+ 93003us) service_pool.cc:224] Handling call
0709 12:15:47.539732 (+1070161us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540032c3d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.539866 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298403200}
I20260709 12:15:47.548834  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:47.520973  9495 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.756186  8251 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.692013  8400 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.600538  9505 raft_consensus.cc:740] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:47.759814  9505 consensus_queue.cc:260] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.761225  9505 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:47.761385  9500 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:15:47.538357  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 229) took 3337 ms. Trace:
I20260709 12:15:47.646526  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:47.763192  8471 rpcz_store.cc:276] 0709 12:15:44.200665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.893277 (+1692612us) service_pool.cc:224] Handling call
0709 12:15:45.893617 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.975667 (+1082050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.538058 (+562391us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400073354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:47.538281 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963715328}
I20260709 12:15:47.763758  8399 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:47.646397  9499 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:47.764626  9499 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.764735  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.765111  9499 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.766202  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.687175  8970 raft_consensus.cc:697] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.768499  8970 consensus_queue.cc:237] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.768914  9487 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.671581  9475 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:47.737219  9422 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.643018  9512 consensus_queue.cc:1048] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.172s
W20260709 12:15:47.417861  8475 rpcz_store.cc:269] 0709 12:15:45.518242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.539936 (+ 21694us) service_pool.cc:224] Handling call
0709 12:15:45.758562 (+218626us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:45.896605 (+138043us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8f8c 00007f124afc8ef6 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:47.381314 (+1484709us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54003066d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:47.388146 (+  6832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381022080}
I20260709 12:15:47.753582  9514 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.739972  9190 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.692431  8476 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 6.
I20260709 12:15:47.664613  8253 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:47.548313  9509 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.192s
I20260709 12:15:47.591749  9407 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:47.598722  9480 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:47.758502  9495 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.785665  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 274) took 1570 ms. Trace:
I20260709 12:15:47.518008  9513 consensus_queue.cc:1059] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.305s
I20260709 12:15:47.524710  9482 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:47.759835  9498 log.cc:927] Time spent T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:15:47.692767  8474 consensus_meta.cc:287] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.004s
I20260709 12:15:47.770323  9489 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:47.771693  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:47.770938  9475 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.771445  9422 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.771448  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 194) took 1997 ms. Trace:
I20260709 12:15:47.816767  8477 raft_consensus.cc:1275] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:47.816527  9478 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.820859  9480 raft_consensus.cc:697] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:47.786772  8479 rpcz_store.cc:276] 0709 12:15:46.215524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.111672 (+896148us) service_pool.cc:224] Handling call
0709 12:15:47.112045 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.112443 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.112478 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:47.112955 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:15:47.330717 (+217762us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:47.780072 (+449355us) log.cc:844] Serialized 14 byte log entry
0709 12:15:47.785344 (+  5272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.785422 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:47.785465 (+    43us) raft_consensus.cc:1685] finished
0709 12:15:47.785474 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.785606 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2731,"raft.queue_time_us":19404,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":666268,"threads_started":2,"wal-append.queue_time_us":285373}
I20260709 12:15:47.836704  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 145) took 2071 ms. Trace:
I20260709 12:15:47.840782  8255 rpcz_store.cc:276] 0709 12:15:45.765000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.239783 (+474783us) service_pool.cc:224] Handling call
0709 12:15:46.240105 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.065528 (+825423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.836358 (+770830us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54005780d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:47.836618 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894829824}
I20260709 12:15:47.773550  9468 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.823272  9356 raft_consensus.cc:3055] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:47.842434  9356 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:47.843362  9356 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.844597  9356 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:47.845534  9468 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.848279  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.849383  8479 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:47.816740  8474 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:47.850613  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.872499  9407 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:47.872867  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 230) took 2597 ms. Trace:
I20260709 12:15:47.873507  8257 rpcz_store.cc:276] 0709 12:15:45.274959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.556702 (+281743us) service_pool.cc:224] Handling call
0709 12:15:45.604063 (+ 47361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:46.098950 (+494887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.872594 (+1773644us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400515254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:47.872764 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986947456}
I20260709 12:15:47.875860  9093 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:47.876494  9235 raft_consensus.cc:3055] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:47.876942  9235 raft_consensus.cc:740] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.877862  9235 consensus_queue.cc:260] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.878262  9480 consensus_queue.cc:237] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:47.879029  9235 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:47.788514  9190 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:47.873334  8248 raft_consensus.cc:2410] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:47.801501  8480 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:47.834594  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.893345  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.839119  9414 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:47.892251  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:47.903545  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 430583us
W20260709 12:15:47.903940  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 450680us
I20260709 12:15:47.915565  8220 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:47.930027  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.896667  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 251) took 1154 ms. Trace:
I20260709 12:15:47.948717  8477 rpcz_store.cc:276] 0709 12:15:46.736913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.123984 (+387071us) service_pool.cc:224] Handling call
0709 12:15:47.816038 (+692054us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:47.816300 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.838364 (+ 22064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:47.891694 (+ 53330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113838848}
I20260709 12:15:47.949549  9190 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:47.950341  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.951654  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:47.952376  8474 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:47.952621  9422 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:47.953521  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:47.954243  8474 raft_consensus.cc:2368] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:47.955328  9526 consensus_queue.cc:1048] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.956310  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:47.965606  8222 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:47.967052  8370 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:47.957243  9299 consensus_meta.cc:287] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.004s
I20260709 12:15:47.957394  9512 raft_consensus.cc:3055] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:47.957724  8248 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:15:47.963433  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:47.969949  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:47.973803  9529 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:47.980551  8403 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:47.988695  8370 leader_election.cc:400] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:47.989226  8370 leader_election.cc:403] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:15:47.954847  9422 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:47.967950  9414 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:47.974437  9512 raft_consensus.cc:740] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:47.968276  8400 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:47.982583  9529 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.992861  8477 raft_consensus.cc:2368] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:47.996846  9414 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.996423  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:48.026163  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:48.030869  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.032370  8297 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:47.824065  8397 rpcz_store.cc:276] 0709 12:15:45.774295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.200190 (+425895us) service_pool.cc:224] Handling call
0709 12:15:46.200607 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:46.200855 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:46.200892 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:46.201453 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:15:46.370845 (+169392us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:46.409984 (+ 39139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:46.463447 (+ 53463us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:47.536988 (+1073541us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:47.771122 (+234134us) raft_consensus.cc:1685] finished
0709 12:15:47.771150 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:47.771366 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14321024,"thread_start_us":139734,"threads_started":1,"wal-append.queue_time_us":283776}
I20260709 12:15:48.038059  8370 leader_election.cc:400] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:48.038115  8297 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:47.994706  9499 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.003752  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.009856  9528 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:48.041610  8398 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:48.042210  9336 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.045990  8257 raft_consensus.cc:1275] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:48.033736  8403 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:48.047436  9245 raft_consensus.cc:3055] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:48.031068  9414 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:48.060141  9485 raft_consensus.cc:3055] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:48.060346  9514 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.066288  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 249) took 1360 ms. Trace:
W20260709 12:15:48.071902  8325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 255) took 2239 ms (client timeout 1736 ms). Trace:
I20260709 12:15:48.062608  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.011495  9529 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.018862  9413 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:48.019344  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.057507  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.077821  8406 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:48.033614  9129 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.041181  9468 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.083096  8479 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.085903  8443 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.115912  8443 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.117233  8443 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.079339  9245 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:48.104597  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.111591  8400 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:48.081173  9485 raft_consensus.cc:740] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:48.104638  8221 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.107645  9482 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.107930  9413 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.124094  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:48.112713  9525 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.127265  9161 consensus_meta.cc:287] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.940s	user 0.013s	sys 0.001s
I20260709 12:15:48.127394  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.076049  9511 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:48.108799  9531 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.114857  8472 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.117048  9480 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:48.151245  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.133533  9413 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.136729  9478 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:48.123657  9093 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:48.077455  9512 consensus_queue.cc:260] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.121943  9191 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:48.133265  9110 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.139271  9161 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.145305  8221 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.176587  8221 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:48.082019  8325 rpcz_store.cc:269] 0709 12:15:45.832394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:45.961207 (+128813us) service_pool.cc:224] Handling call
0709 12:15:48.071496 (+2110289us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b5400081954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:48.071750 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47051648}
I20260709 12:15:48.148705  9475 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.183014  8404 raft_consensus.cc:1240] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:48.150666  9235 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:48.116482  9129 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.161320  8970 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:48.128072  9274 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:15:48.122866  9422 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.173631  9499 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:48.161448  8222 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.142236  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.178776  8221 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.082405  8473 rpcz_store.cc:276] 0709 12:15:46.706190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.122786 (+416596us) service_pool.cc:224] Handling call
0709 12:15:47.178029 (+ 55243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:47.686875 (+508846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.065914 (+379039us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54008c8f54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:48.066197 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613572864}
I20260709 12:15:48.189994  9191 raft_consensus.cc:697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:48.191182  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.219233  8405 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:48.219319  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 58557.9us
I20260709 12:15:48.160074  9478 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.151631  9511 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.120288  9468 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.191499  8472 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:48.166168  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:48.200884  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 162874us
I20260709 12:15:48.153153  9531 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.181125  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.181001  9389 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.142796  9525 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.181968  9512 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.159556  9245 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.186264  9475 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:48.192862  8251 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:48.209088  8970 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.182168  9538 raft_consensus.cc:2804] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:48.225790  8297 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.169716  9485 consensus_queue.cc:260] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.243589  9485 raft_consensus.cc:3060] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:48.244716  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.216192  9422 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.227720  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 282) took 1024 ms. Trace:
I20260709 12:15:48.252017  8472 rpcz_store.cc:276] 0709 12:15:47.202918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.181221 (+978303us) service_pool.cc:224] Handling call
0709 12:15:48.191190 (+  9969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.225262 (+ 34072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.227647 (+  2385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.253780  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.223415  9235 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:48.223213  9536 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:48.222903  9478 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.227880  8474 raft_consensus.cc:2393] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.233982  9545 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:48.235006  9299 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:48.227837  9191 consensus_queue.cc:237] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.283893  9483 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.287654  8970 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.287739  9161 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.264086  9480 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.289500  9480 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.293354  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 280) took 1091 ms. Trace:
I20260709 12:15:48.293933  8479 rpcz_store.cc:276] 0709 12:15:47.202381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.850304 (+647923us) service_pool.cc:224] Handling call
0709 12:15:48.293072 (+442768us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000aad54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:48.293270 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486223744}
I20260709 12:15:48.272343  9422 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:48.297402  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.298290  8406 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:48.300079  9531 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:48.301599  9544 log.cc:927] Time spent T faea1550226d4b32b5e0955096972f73 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:15:48.302218  9474 log.cc:927] Time spent T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 1.521s	user 0.000s	sys 0.003s
I20260709 12:15:48.304201  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:48.304639  9525 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.305219  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 140) took 1104 ms. Trace:
I20260709 12:15:48.305043  9414 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.305622  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.305676  8475 rpcz_store.cc:276] 0709 12:15:47.200678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.303844 (+1103166us) service_pool.cc:224] Handling call
0709 12:15:48.305148 (+  1304us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:48.282730  9537 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 12:15:48.239804  9538 raft_consensus.cc:697] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:48.309113  9538 consensus_queue.cc:237] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.313083  9480 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:48.315255  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.316078  8251 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:48.318382  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.240338  9511 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:48.241458  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.324477  8401 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:48.230737  8477 raft_consensus.cc:1275] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:48.326211  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 276) took 1125 ms. Trace:
I20260709 12:15:48.326604  8477 rpcz_store.cc:276] 0709 12:15:47.201257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.180666 (+979409us) service_pool.cc:224] Handling call
0709 12:15:48.208856 (+ 28190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.325897 (+117041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.326148 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.249421  8405 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:48.328500  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 257) took 1074 ms. Trace:
I20260709 12:15:48.328922  8477 rpcz_store.cc:276] 0709 12:15:47.254311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.327564 (+1073253us) service_pool.cc:224] Handling call
0709 12:15:48.327908 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.328126 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:48.328161 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:48.328214 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:48.328254 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.328320 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.328440 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.329969  8405 raft_consensus.cc:1275] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:48.254748  8472 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
W20260709 12:15:48.265738  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.267983  9548 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.240268  9468 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.331573  8478 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:48.331682  9468 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.332334  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 252) took 1296 ms. Trace:
I20260709 12:15:48.332283  9468 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.334543  9468 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:48.268674  9249 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.271847  9536 raft_consensus.cc:697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:48.335678  8405 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:48.335563  9249 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.335976  9536 consensus_queue.cc:237] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.236378  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:48.338047  8473 raft_consensus.cc:2368] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:48.338222  9249 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.236066  9129 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:48.247028  9475 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:48.255105  9389 consensus_queue.cc:1059] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:15:48.316097  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.322338  9336 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.322979  9480 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.335075  9468 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.339311  8406 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.369306  8404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 384) took 1210 ms. Trace:
I20260709 12:15:48.332816  8478 rpcz_store.cc:276] 0709 12:15:47.035924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.131135 (+ 95211us) service_pool.cc:224] Handling call
0709 12:15:48.331188 (+1200053us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:48.331375 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.332068 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.332276 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96457984}
I20260709 12:15:48.265481  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:48.272672  8257 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:48.331754  8445 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.373099  8445 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.349380  8473 raft_consensus.cc:1275] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:48.350226  9389 raft_consensus.cc:3055] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:48.350733  8474 raft_consensus.cc:1240] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:48.351272  9129 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.378504  8298 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:48.353385  8250 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:48.370018  8404 rpcz_store.cc:276] 0709 12:15:47.159246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.159413 (+   167us) service_pool.cc:224] Handling call
0709 12:15:47.159845 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.183524 (+1023679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.368869 (+185345us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400188654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:48.369207 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352434944}
I20260709 12:15:48.379958  8298 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:48.367494  9480 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.379520  9358 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:48.377836  9336 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.379688  9497 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:48.390667  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 209) took 1397 ms. Trace:
I20260709 12:15:48.376511  9389 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:48.361510  9475 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.374615  9468 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.428448  9485 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.388880  9129 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.419090  9497 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.434156  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:48.376561  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 151380us
I20260709 12:15:48.438617  8478 raft_consensus.cc:1275] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:48.446830  9545 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:48.447489  9545 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.447764  9480 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.448019  9545 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:48.430866  9529 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.451361  9529 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.440341  8403 raft_consensus.cc:1275] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:48.453552  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.454169  8403 raft_consensus.cc:3060] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.443607  8369 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.423483  9358 raft_consensus.cc:697] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:48.455962  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.468211  8406 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:48.469367  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.430310  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.421187  9336 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.452826  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.455178  9497 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.452276  9413 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.458912  9475 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.424202  8250 rpcz_store.cc:276] 0709 12:15:46.992030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:46.994673 (+  2643us) service_pool.cc:224] Handling call
0709 12:15:48.315921 (+1321248us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:48.389081 (+ 73160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43860864}
I20260709 12:15:48.460829  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:48.461656  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.463454  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.465747  9468 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.489646  9522 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:48.473001  8296 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:48.478937  8403 raft_consensus.cc:2468] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:48.453310  9249 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.519767  8445 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.429306  9485 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:48.502848  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.470882  8397 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
W20260709 12:15:48.506531  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 167898us
I20260709 12:15:48.466395  8297 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.479859  9550 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:15:48.524672  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 51745.7us
I20260709 12:15:48.503819  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.487612  8473 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
W20260709 12:15:48.547976  8443 leader_election.cc:336] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.754s (SENT)
I20260709 12:15:48.553501  8443 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.549549  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:48.525409  8403 raft_consensus.cc:1275] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:48.492570  8474 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:48.511049  8253 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.510939  8477 raft_consensus.cc:1240] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:48.546782  9274 raft_consensus.cc:2804] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:48.504530  9191 consensus_queue.cc:1048] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:15:48.476418  9389 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:48.566789  9553 consensus_queue.cc:1059] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:48.544521  9414 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.563320  9499 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:48.544185  9468 consensus_queue.cc:1059] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:15:48.550279  9358 consensus_queue.cc:237] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.574108  9485 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:48.577580  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:48.579134  9274 raft_consensus.cc:697] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:48.579303  8402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 295) took 1110 ms. Trace:
I20260709 12:15:48.547137  9249 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.581629  9336 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.579209  9413 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.595702  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:48.612365  8403 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.608466  8402 rpcz_store.cc:276] 0709 12:15:47.469779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.470331 (+   552us) service_pool.cc:224] Handling call
0709 12:15:47.470789 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.782718 (+311929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:47.782799 (+    81us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:48.362713 (+579914us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b2c000af5d8. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124c9e6a11 00007f124c9f6372 00007f124e128a01 00007f124e0ed43a 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2
0709 12:15:48.363181 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:15:48.474513 (+111332us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:48.474552 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.474623 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:48.578908 (+104285us) raft_consensus.cc:1685] finished
0709 12:15:48.578937 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:48.579222 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55280,"raft.queue_time_us":75487,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":58807040,"thread_start_us":366839,"threads_started":2,"wal-append.queue_time_us":195601}
I20260709 12:15:48.614032  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:48.615036  8403 raft_consensus.cc:2393] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:48.583076  8401 raft_consensus.cc:2393] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:48.609387  8370 leader_election.cc:400] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:48.617641  8370 leader_election.cc:403] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:15:48.623202  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 240680us
I20260709 12:15:48.625847  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:48.588322  9485 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:48.644335  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.611662  8397 raft_consensus.cc:1275] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260709 12:15:48.663851  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:48.591629  9549 log.cc:927] Time spent T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:15:48.606273  9245 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.600138  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.577677  9129 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.610397  9336 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.695154  8222 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.696486  8222 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:48.676895  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 210881us
I20260709 12:15:48.630136  9522 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:48.678761  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:48.610081  9249 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:48.610248  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 218) took 1183 ms. Trace:
I20260709 12:15:48.678741  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:48.702754  8330 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.703305  8332 raft_consensus.cc:2393] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:48.699574  9538 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:48.608330  9274 consensus_queue.cc:237] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.680204  8249 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:48.681648  8474 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:48.682168  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:48.671746  9342 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.683776  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:48.715831  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:48.650940  9509 consensus_queue.cc:1048] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:15:48.699323  8297 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.694016  9495 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.712261  8222 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.707731  9538 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.719146  8330 raft_consensus.cc:2468] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:48.750120  8369 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.750180  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:48.753842  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 54600.4us
W20260709 12:15:48.754312  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.756280  8297 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.760810  8369 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.684836  9497 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:48.582954  9478 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.719976  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 247) took 1449 ms. Trace:
I20260709 12:15:48.720116  9342 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.736174  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:48.782274  8331 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:48.736590  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:48.736735  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.711424  9417 consensus_queue.cc:1059] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:15:48.737232  9495 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.737988  9536 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:48.738405  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.739202  9025 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:48.701560  9413 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:48.807227  9289 raft_consensus.cc:3055] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:48.807411  9413 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.807698  9289 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:48.807890  9413 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:48.808660  9289 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.809805  9495 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:48.806718  9536 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.810563  9536 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:48.748816  8443 leader_election.cc:336] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 2.011s (SENT)
I20260709 12:15:48.762236  9352 consensus_queue.cc:1048] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.763697  9545 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.767103  9522 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.846244  8479 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:48.701050  9526 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:48.715665  9511 consensus_queue.cc:1059] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:15:48.702471  8248 rpcz_store.cc:276] 0709 12:15:47.426756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.948549 (+521793us) service_pool.cc:224] Handling call
0709 12:15:47.948986 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:47.991946 (+ 42960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:48.609988 (+618042us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b5400269b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:48.610185 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19467136}
I20260709 12:15:48.713828  9129 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:15:48.775789  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.701411  9022 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:15:48.794816  8324 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:48.795574  9553 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:48.781738  8249 rpcz_store.cc:276] 0709 12:15:47.266160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.599875 (+1333715us) service_pool.cc:224] Handling call
0709 12:15:48.715525 (+115650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:48.753029  9538 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.806876  9414 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:48.803968  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 80106.6us
I20260709 12:15:48.811678  8443 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:48.911979  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 163187us
W20260709 12:15:48.913789  8443 leader_election.cc:336] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 2.053s (SENT)
I20260709 12:15:48.914250  8443 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:48.903671  8473 raft_consensus.cc:2393] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:48.831508  8369 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:48.862646  9550 raft_consensus.cc:697] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
W20260709 12:15:48.863907  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 314099us
W20260709 12:15:48.919260  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 87897.5us
I20260709 12:15:48.920603  8369 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:48.887353  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 128955us
I20260709 12:15:48.848466  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:48.806150  9436 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.898445  9468 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:48.809978  9289 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:48.803689  8474 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:48.939272  9522 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:48.939719  9522 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.940052  9522 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:48.941419  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:48.942462  8480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 142) took 1499 ms. Trace:
I20260709 12:15:48.915529  9414 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:48.791067  9509 raft_consensus.cc:2804] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:48.909556  9229 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:48.917266  8443 leader_election.cc:336] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.630s (SENT)
W20260709 12:15:48.987573  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 70339.7us
W20260709 12:15:48.988368  8443 leader_election.cc:336] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.736s (SENT)
I20260709 12:15:48.988812  8443 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:48.906219  9556 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.924665  9575 consensus_queue.cc:1048] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:48.933491  9475 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:49.016260  9475 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:48.902377  9553 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:48.896447  9526 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:48.942862  8480 rpcz_store.cc:276] 0709 12:15:47.442711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.889207 (+446496us) service_pool.cc:224] Handling call
0709 12:15:48.941224 (+1052017us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:48.942392 (+  1168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6376192}
I20260709 12:15:48.904374  9129 raft_consensus.cc:697] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:48.929576  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:48.896884  9518 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:15:49.016281  9274 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.949509  9436 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.018752  9545 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.003315  9229 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.020745  9093 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.021504  9478 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.022892  9556 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:48.951591  9511 consensus_queue.cc:1048] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:15:48.919480  9480 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.026260  9564 consensus_queue.cc:1059] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:49.031411  9468 consensus_queue.cc:1048] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:48.916129  9565 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:49.034320  9509 raft_consensus.cc:697] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:48.916323  9358 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:48.934578  9550 consensus_queue.cc:237] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.125262  9509 consensus_queue.cc:237] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.003465  9561 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.127365  9561 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.128707  9229 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.130123  9561 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:48.987352  9414 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.037521  9562 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.048424  9475 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.047742  9553 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.139200  9562 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.142355  9562 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.146370  9556 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.151769  9436 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.055354  9249 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:49.156118  9249 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.134438  9497 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:49.168377  9342 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.169785  9526 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.158962  9249 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.168104  9536 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:49.182416  9538 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.235270  9538 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:49.222031  9245 consensus_meta.cc:287] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
W20260709 12:15:49.222841  9485 consensus_meta.cc:287] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 12:15:49.237540  9485 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.212729  9522 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.227059  9536 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.252686  9475 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.256398  9475 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.318503  9475 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:49.293536  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 373537us
W20260709 12:15:49.294865  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 344081us
I20260709 12:15:49.297210  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:48.938758  8329 raft_consensus.cc:1275] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:15:49.303601  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 398433us
I20260709 12:15:49.304371  8400 raft_consensus.cc:2410] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:15:49.304977  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 394005us
I20260709 12:15:49.307446  8325 raft_consensus.cc:1240] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:49.309018  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:49.311144  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 215) took 1885 ms (client timeout 2509 ms). Trace:
I20260709 12:15:49.312795  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:49.313197  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:49.313830  8446 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41731 timed out after 1.909s (SENT) [suppressed 14 similar messages]
I20260709 12:15:49.053064  8479 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:49.359612  8328 raft_consensus.cc:2368] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:49.360988  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 144) took 1456 ms. Trace:
I20260709 12:15:49.314342  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.359552  8475 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:49.315305  9129 consensus_queue.cc:237] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:49.316789  8372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:48.946115  8253 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:49.241245  9522 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.230721  9553 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:49.318871  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 330365us
I20260709 12:15:49.333441  8476 raft_consensus.cc:1240] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 12:15:49.361546  8477 rpcz_store.cc:276] 0709 12:15:47.904015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.348912 (+444897us) service_pool.cc:224] Handling call
0709 12:15:48.351919 (+  3007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.567615 (+215696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.360314 (+792699us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003066d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:49.360732 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320785280}
W20260709 12:15:49.352015  8256 rpcz_store.cc:269] 0709 12:15:47.425796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.523721 (+ 97925us) service_pool.cc:224] Handling call
0709 12:15:49.310498 (+1786777us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b5400268254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:49.310808 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209871232}
I20260709 12:15:49.091827  9093 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.315214  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 387) took 1346 ms. Trace:
W20260709 12:15:49.379822  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 45771.9us
I20260709 12:15:49.392122  9550 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.362533  8326 raft_consensus.cc:2393] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:49.337467  8472 raft_consensus.cc:1240] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:49.436767  9475 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.438627  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.459467  9553 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.441723  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.461390  9536 consensus_queue.cc:1048] T ea8792e9c5a048e987bab09333071e2e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:49.442233  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:49.457046  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 286) took 2141 ms. Trace:
I20260709 12:15:49.456887  9550 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:49.465219  8370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.459656  8249 raft_consensus.cc:2368] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:15:49.439818  9582 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:49.231567  9413 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.458410  9561 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:49.451543  8372 connection.cc:256] RPC call timeout handler was delayed by -1.1792315449999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:15:49.472620  8372 connection.cc:256] RPC call timeout handler was delayed by -1.1726909440001236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 12:15:49.451326  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 290) took 1148 ms. Trace:
I20260709 12:15:49.478672  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:49.479380  9550 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.479736  8404 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.479647  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:49.477236  9336 raft_consensus.cc:3055] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:49.481390  9561 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.482070  9336 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:49.447996  8399 rpcz_store.cc:276] 0709 12:15:47.968868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.972534 (+  3666us) service_pool.cc:224] Handling call
0709 12:15:48.602446 (+629912us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:48.602658 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:48.602904 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:48.845268 (+242364us) log.cc:844] Serialized 14 byte log entry
0709 12:15:49.314126 (+468858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:49.314263 (+   137us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:49.314403 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.314593 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:49.314920 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130151,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":32,"raft.queue_time_us":41058,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":398,"spinlock_wait_cycles":7950848,"thread_start_us":627140,"threads_started":2,"wal-append.queue_time_us":283101}
I20260709 12:15:49.483151  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.484758  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:49.485476  8403 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.485432  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 255) took 2333 ms. Trace:
I20260709 12:15:49.486713  8397 raft_consensus.cc:1275] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.487210  8476 rpcz_store.cc:276] 0709 12:15:47.139523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:47.997025 (+857502us) service_pool.cc:224] Handling call
0709 12:15:49.332252 (+1335227us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:49.332656 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:49.451235 (+118579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.472507 (+ 21272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5169024}
I20260709 12:15:49.488215  9245 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.489154  9245 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.489601  8221 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:49.490283  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.491525  8325 raft_consensus.cc:2393] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:49.493460  9536 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:49.493935  9536 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.494071  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:49.494669  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:49.494750  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:49.495723  8325 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.496025  8405 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:49.495047  8326 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.497730  9561 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.465504  8472 rpcz_store.cc:276] 0709 12:15:47.315489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.331108 (+1015619us) service_pool.cc:224] Handling call
0709 12:15:49.336107 (+1004999us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:49.336758 (+   651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:49.456622 (+119864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:49.456921 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17543424}
I20260709 12:15:49.501389  9245 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.494338  9536 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:49.474728  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 161109us
I20260709 12:15:49.475666  8475 rpcz_store.cc:276] 0709 12:15:48.296026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:49.311714 (+1015688us) service_pool.cc:224] Handling call
0709 12:15:49.444679 (+132965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:49.486656  9093 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:49.508490  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 66648.7us
I20260709 12:15:49.510226  9025 raft_consensus.cc:3055] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:49.516242  9025 raft_consensus.cc:740] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:49.517524  9025 consensus_queue.cc:260] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:49.534591  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 100309us
W20260709 12:15:49.536831  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.524758  9586 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.540548  9586 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.544603  8479 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 7.
I20260709 12:15:49.528913  9548 raft_consensus.cc:3055] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:49.546012  9336 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.551281  9586 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.551416  8369 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:49.532502  9249 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.554198  8404 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
W20260709 12:15:49.555982  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 66716.9us
W20260709 12:15:49.558403  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.557021  8399 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:49.560307  8330 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:49.561089  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.561302  9522 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.544291  9245 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:49.181198  9414 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.562119  8249 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.565794  9522 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:49.552783  9548 raft_consensus.cc:740] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:49.575989  8257 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:49.578147  9336 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.578402  8369 leader_election.cc:400] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Vote denied by peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513) with higher term. Message: Invalid argument: T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3.
I20260709 12:15:49.583853  8403 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:49.585817  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.586375  9553 raft_consensus.cc:3055] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:49.586946  9553 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
W20260709 12:15:49.588065  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.589941  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.591719  8253 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:49.592171  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.593113  8252 raft_consensus.cc:2368] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:49.593560  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.594321  9299 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.594542  8256 raft_consensus.cc:2393] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:49.582300  9296 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.595371  9299 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.595630  9522 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:49.596285  9586 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.596508  9545 raft_consensus.cc:3055] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:49.599874  9545 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:49.601251  9545 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.603442  9509 consensus_queue.cc:1059] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:15:49.602753  9580 log.cc:927] Time spent T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.471s	user 0.006s	sys 0.011s
I20260709 12:15:49.605252  8257 raft_consensus.cc:1275] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.606078  9025 raft_consensus.cc:3060] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:49.586447  9569 log.cc:927] Time spent T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.470s	user 0.010s	sys 0.007s
I20260709 12:15:49.609639  8372 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:49.587564  9249 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.579666  9245 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.611750  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.618645  9518 raft_consensus.cc:3055] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:49.620263  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.624377  9475 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.625181  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.618793  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.624537  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.627542  9509 raft_consensus.cc:2749] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.627625  8298 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:49.627871  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 94716.7us
I20260709 12:15:49.619782  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.617455  9522 consensus_queue.cc:1048] T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:15:49.630069  8253 raft_consensus.cc:2368] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:49.635579  9581 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.619390  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.637589  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:49.640003  8250 raft_consensus.cc:2368] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:49.619947  9413 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:49.642105  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.642243  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:49.629522  9518 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:49.645658  8257 raft_consensus.cc:2410] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:49.674721  8330 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:49.670961  8297 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:49.652977  8443 leader_election.cc:336] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.828s (SENT)
I20260709 12:15:49.645077  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.650682  9545 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.644850  9538 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.644919  9547 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:49.686144  9526 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.686007  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.679895  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.687835  9289 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.691989  8323 raft_consensus.cc:1275] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.696131  8326 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:49.640071  9548 consensus_queue.cc:260] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.684496  8372 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:49.700029  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:49.663546  8329 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:49.645195  8400 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54482 (request call id 209) took 1621 ms (client timeout 1908 ms). Trace:
I20260709 12:15:49.672698  8252 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:49.707119  8332 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
W20260709 12:15:49.714355  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 48460.1us
I20260709 12:15:49.716619  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.718683  8404 raft_consensus.cc:2393] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:49.652771  9581 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.719688  9289 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.721812  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:49.722553  8406 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.722005  9518 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.714447  9582 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:49.723600  9518 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.723786  9582 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.724484  9582 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.727439  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:49.728247  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:49.730132  9525 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:49.733307  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 79775.7us
I20260709 12:15:49.734237  8372 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:49.735181  9509 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.739638  9475 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:49.739507  9536 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:49.740103  9475 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.740505  9475 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.740312  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.741727  8250 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:49.741948  9536 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.718140  9526 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:49.730881  9525 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.723592  9289 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.763588  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.713205  9547 raft_consensus.cc:697] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:49.769704  8298 leader_election.cc:400] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:15:49.770104  8298 leader_election.cc:403] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:15:49.770826  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 189342us
I20260709 12:15:49.730935  9581 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.776090  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.779841  8250 raft_consensus.cc:2410] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:15:49.780088  9571 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.656s	user 0.001s	sys 0.018s
I20260709 12:15:49.738831  8249 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:49.767531  9548 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:49.782856  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 129934us
I20260709 12:15:49.769564  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.785033  8248 raft_consensus.cc:1240] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:49.785362  8252 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:49.787510  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 116591us
W20260709 12:15:49.788481  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 54388.4us
I20260709 12:15:49.789729  8372 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:49.790747  9522 raft_consensus.cc:2764] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:15:49.793620  9526 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.795111  9511 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.797628  9414 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:49.799443  9495 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.788928  9553 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.800772  9389 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.801388  9553 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:49.802381  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:49.805514  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 69697.8us
I20260709 12:15:49.805913  8251 raft_consensus.cc:2468] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:49.806329  9129 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:49.786293  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.807634  8256 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 2.
I20260709 12:15:49.807920  9525 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:49.808557  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.799504  8248 raft_consensus.cc:1275] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:49.810348  8252 raft_consensus.cc:1275] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260709 12:15:49.811167  8325 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:49.811723  9561 raft_consensus.cc:2764] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:15:49.812619  8255 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:49.812318  9581 consensus_queue.cc:1048] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:49.813333  9417 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.813679  9342 consensus_queue.cc:1059] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:49.813868  9289 consensus_queue.cc:1059] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:49.813934  9417 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.813285  8222 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.815049  9511 raft_consensus.cc:3055] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:49.815275  9226 raft_consensus.cc:3055] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:49.818090  9511 raft_consensus.cc:740] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:49.815797  8446 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:49.819955  9511 consensus_queue.cc:260] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.818537  9226 raft_consensus.cc:740] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:49.816211  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.821636  9511 raft_consensus.cc:3060] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.816452  9249 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.821768  9226 consensus_queue.cc:260] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:49.823764  9226 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.824246  8323 raft_consensus.cc:1240] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:49.824744  8298 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:49.817278  9522 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:15:49.826161  9550 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:49.826789  9550 raft_consensus.cc:697] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:49.827912  8372 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:49.827858  9550 consensus_queue.cc:237] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:49.828998  9522 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:49.829433  9522 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.829890  9522 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:49.816906  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 183192us
I20260709 12:15:49.831696  8298 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:49.832466  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:49.821717  8250 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:49.809146  9299 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:49.717180  8400 rpcz_store.cc:269] 0709 12:15:48.023404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.140598 (+117194us) service_pool.cc:224] Handling call
0709 12:15:49.644914 (+1504316us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001e2154. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:49.645100 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475631872}
I20260709 12:15:49.837734  8406 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
W20260709 12:15:49.840541  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.841552  8297 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:49.842303  8255 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 158) took 1866 ms (client timeout 1539 ms). Trace:
I20260709 12:15:49.842675  9245 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:49.781386  9538 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:49.843995  8255 rpcz_store.cc:269] 0709 12:15:47.976291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.062292 (+ 86001us) service_pool.cc:224] Handling call
0709 12:15:49.842061 (+1779769us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400268754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:49.842204 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3978669312}
I20260709 12:15:49.849625  8332 raft_consensus.cc:1275] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.850462  9299 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.850710  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.851011  8369 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.851505  8325 raft_consensus.cc:1240] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:49.851727  8327 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:49.851948  8369 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.836943  9495 raft_consensus.cc:2749] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:49.834507  9586 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.838740  9336 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:49.855237  9509 raft_consensus.cc:2804] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:49.865010  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.865983  8323 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:49.866822  9556 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:49.859710  9342 consensus_queue.cc:1048] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:49.867116  9582 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.859488  9296 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.872529  9296 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:49.874574  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 46800.8us
I20260709 12:15:49.875483  9538 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:49.874622  9586 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:49.876590  9586 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.876962  9586 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:49.861153  9336 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.877532  9336 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.875589  8372 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:49.878927  9582 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:49.880303  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.880523  8370 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:49.863552  9525 raft_consensus.cc:2804] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:49.881613  8222 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.850805  9245 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:49.871614  8252 raft_consensus.cc:1240] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:49.881156  8327 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:49.899811  8369 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.817037  9547 consensus_queue.cc:237] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:49.895243  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:49.880380  9417 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:49.910698  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.904685  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.881186  9296 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:49.920959  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 56359us
I20260709 12:15:49.900833  9525 raft_consensus.cc:697] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:49.904752  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.880347  9495 consensus_queue.cc:1059] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:15:49.926481  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 85063.5us
W20260709 12:15:49.927965  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 52530.9us
I20260709 12:15:49.919860  9509 raft_consensus.cc:697] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:49.930866  8330 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:49.931303  8446 leader_election.cc:400] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
I20260709 12:15:49.932075  9296 consensus_queue.cc:1059] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:49.933982  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:49.940094  8254 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:49.927811  9417 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:49.942206  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:49.942545  9605 raft_consensus.cc:3055] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:49.957248  9605 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:49.957767  8323 raft_consensus.cc:1275] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.958352  9605 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:49.959889  9605 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.959379  8155 catalog_manager.cc:5697] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.943168  9601 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:49.945343  8221 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:49.946656  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:49.946817  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:49.947140  8475 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.906394  9245 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:49.949234  8446 leader_election.cc:403] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:49.949065  8222 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.956110  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:49.956521  8325 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:49.967108  8479 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:49.969421  8372 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:49.971309  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 82384.2us
I20260709 12:15:49.961630  8155 catalog_manager.cc:5697] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.972352  8369 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:49.967998  8473 raft_consensus.cc:1275] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:49.968372  9417 raft_consensus.cc:697] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:49.982527  9536 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:49.985077  9536 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:49.985509  9536 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.982540  8221 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:49.979171  8476 raft_consensus.cc:3060] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:15:49.992298  8297 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:49.992822  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 113550us
I20260709 12:15:49.983335  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:50.014207  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 65207.2us
I20260709 12:15:50.024900  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.026712  9249 consensus_queue.cc:1048] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:50.027204  8474 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:50.028348  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.028584  9525 consensus_queue.cc:237] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.029182  9296 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:50.030045  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.032191  9336 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.022760  9561 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:50.034179  9129 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:15:50.036796  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.037452  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:50.038492  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.039361  8397 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:50.025888  9245 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:50.024994  9509 consensus_queue.cc:237] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:50.028213  9249 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.086205  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:50.043900  8297 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:50.042740  9601 raft_consensus.cc:2804] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:50.089143  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:50.041560  8155 catalog_manager.cc:5697] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 0 to 1, leader changed from <none> to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 1 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.040567  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:49.989959  9417 consensus_queue.cc:237] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:50.089779  8255 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:50.086905  8404 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:50.092438  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.091025  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 118712us
I20260709 12:15:50.042554  9389 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:50.112560  8369 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.115073  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:50.115839  8474 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:50.119103  9609 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.119697  9603 raft_consensus.cc:2749] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:50.119782  9609 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:50.120924  9608 raft_consensus.cc:2764] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:15:50.125564  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 206450us
I20260709 12:15:50.126000  8476 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:50.127780  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:50.128328  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:50.128548  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 209691us
I20260709 12:15:50.129707  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:50.130473  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.130223  9536 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:50.130972  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.134904  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 141075us
I20260709 12:15:50.064131  9336 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.133594  8330 raft_consensus.cc:1275] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:50.145414  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.146059  8330 raft_consensus.cc:2393] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:50.146628  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.084461  9296 raft_consensus.cc:697] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:50.147658  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.147842  9296 consensus_queue.cc:237] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:50.148874  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.149449  8330 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:50.088788  8325 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:50.110805  8328 raft_consensus.cc:2410] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:50.086258  9249 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.143335  8222 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.151412  9249 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.151804  9511 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:50.119853  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.211786  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:50.168710  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.154290  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 43913.1us
I20260709 12:15:50.134531  9129 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:50.134264  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 220) took 1674 ms. Trace:
I20260709 12:15:50.132861  9606 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:50.217234  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:50.220902  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 65468.7us
I20260709 12:15:50.133708  9601 raft_consensus.cc:697] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:50.218603  8369 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.152267  9511 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.220005  8332 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:50.218621  9245 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.134208  9583 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:50.224676  8331 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:50.132745  9093 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.134508  9604 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.220448  9518 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:50.122871  9609 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:50.114336  8401 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:50.141865  9389 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:50.132571  9495 consensus_queue.cc:1048] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:15:50.134491  9586 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:50.226780  9606 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.226432  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.300294  9093 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.300710  9601 consensus_queue.cc:237] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:50.301426  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.335599  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.335954  8480 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
W20260709 12:15:50.302179  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 339641us
I20260709 12:15:50.304459  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.304114  9495 consensus_queue.cc:1059] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:50.233723  9245 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:50.305435  8473 raft_consensus.cc:2410] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:50.222728  8254 rpcz_store.cc:276] 0709 12:15:48.460002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:48.474209 (+ 14207us) service_pool.cc:224] Handling call
0709 12:15:50.134076 (+1659867us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540026a054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:50.134204 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190997888}
I20260709 12:15:50.306326  9342 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.350049  9342 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:50.352346  9615 log.cc:927] Time spent T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:15:50.352566  9342 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:50.355192  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.355909  8372 leader_election.cc:400] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:50.356302  8372 leader_election.cc:403] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:50.356415  9495 raft_consensus.cc:3055] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:50.356829  9495 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:50.357580  8372 leader_election.cc:400] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:50.357790  9495 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:50.359392  9593 log.cc:927] Time spent T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.715s	user 0.000s	sys 0.012s
I20260709 12:15:50.360448  9093 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:50.360774  8327 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:50.300743  9389 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.308279  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:50.309674  8403 raft_consensus.cc:1275] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:50.309746  9518 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.233596  9603 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.234019  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.234169  9511 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:50.324127  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 111912us
I20260709 12:15:50.324746  8406 raft_consensus.cc:1275] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:50.234349  9536 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:50.336306  8332 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
W20260709 12:15:50.322639  9475 consensus_meta.cc:287] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.003s
I20260709 12:15:50.347333  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.313068  9584 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5.
W20260709 12:15:50.389966  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 175063us
I20260709 12:15:50.359174  9609 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 3. Current term is 4.
I20260709 12:15:50.363986  8222 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.393074  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.358688  8372 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:50.324556  9606 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:50.349305  9602 log.cc:927] Time spent T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:15:50.401995  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.403122  9475 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.405790  9475 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.406488  9475 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:50.408649  8253 raft_consensus.cc:2468] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:50.367654  8331 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:50.368701  8404 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:50.347476  8324 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.375260  8323 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 7.
I20260709 12:15:50.375862  9518 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.377473  9603 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:50.378006  9495 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:50.296932  9583 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.373224  9608 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.381019  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.382100  8402 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:15:50.241973  9604 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:50.362226  9245 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.395983  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:50.430136  8480 raft_consensus.cc:3060] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:50.396221  9022 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:50.396948  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.432264  8332 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.397330  8372 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:50.409035  9522 consensus_meta.cc:287] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.004s
I20260709 12:15:50.411098  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.420671  9299 raft_consensus.cc:3055] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:50.421247  8479 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:50.389590  9129 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
F20260709 12:15:50.409160  3211 test_workload.cc:382] Timed out: Timed out waiting for Table Creation
*** Check failure stack trace: ***
I20260709 12:15:50.422472  8221 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
*** Aborted at 1783599350 (unix time) try "date -d @1783599350" if you are using GNU date ***
W20260709 12:15:50.628351  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 212412us
W20260709 12:15:50.629691  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.630379  8221 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:50.425067  8402 pending_rounds.cc:85] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 2
I20260709 12:15:50.631290  8402 pending_rounds.cc:107] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:15:50.434103  8331 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:50.419098  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.414949  8325 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 1.
I20260709 12:15:50.443142  9518 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:50.423136  9603 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.450728  8255 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:50.436682  8398 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:50.430846  9604 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.433509  9022 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.456302  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:50.458021  8443 leader_election.cc:336] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.543s (SENT)
I20260709 12:15:50.463145  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.435720  9299 raft_consensus.cc:740] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:50.463939  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 66683.5us
I20260709 12:15:50.467845  8155 catalog_manager.cc:5697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 1 to 2, leader changed from b3421ee20b674b879e0633e39c5709d7 (127.3.34.195) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } }
I20260709 12:15:50.455928  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.436844  9608 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:50.435504  9522 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.456077  9129 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:50.496181  8324 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:50.497110  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.500593  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:50.504077  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.656219  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.656991  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.657203  9522 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.657568  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.658622  8400 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:50.453428  9622 consensus_queue.cc:1048] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:15:50.508498  9583 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.482980  8328 raft_consensus.cc:2393] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:50.658506  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.650584  9548 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.498642  9586 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:50.523754  9289 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.649786  9245 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:50.522221  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 65507us
I20260709 12:15:50.479750  9624 consensus_queue.cc:1048] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:15:50.541234  8332 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
W20260709 12:15:50.542538  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 54624.4us
I20260709 12:15:50.485877  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.479552  9093 consensus_queue.cc:1048] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:15:50.550614  9525 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:50.643836  9536 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.553148  8480 raft_consensus.cc:2468] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:50.549530  8474 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:50.546960  9526 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:15:50.551625  9511 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:50.566826  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 89642.1us
I20260709 12:15:50.571803  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.574102  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:50.608146  9249 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:50.609126  9612 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 12:15:50.594930  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.574016  9606 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:50.615728  9611 log.cc:927] Time spent T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
W20260709 12:15:50.612746  9628 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:15:50.614594  9629 log.cc:927] Time spent T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:15:50.631649  8402 raft_consensus.cc:2889] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:50.632576  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.662346  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:50.631575  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.642369  8369 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:50.789004  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 146727us
I20260709 12:15:50.674017  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:50.645697  8479 raft_consensus.cc:2393] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:50.646587  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 227565us
I20260709 12:15:50.648033  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.648768  9414 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:50.647228  9417 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:50.796432  8478 raft_consensus.cc:2368] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6.
I20260709 12:15:50.666762  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.798218  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.669981  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:50.646942  9022 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:50.661139  8472 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:50.661389  8155 catalog_manager.cc:5697] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 1 to 2, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:50.807942  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.809244  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.810477  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.664340  8406 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:50.675124  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 44897.1us
I20260709 12:15:50.661580  9299 consensus_queue.cc:260] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.659525  8405 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:50.660962  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.811949  9299 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:50.812664  8397 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:50.813454  8400 raft_consensus.cc:1240] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:50.813900  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.696556  8330 raft_consensus.cc:2410] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 3 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:50.670789  8251 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:50.633565  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.662065  9548 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.781934  9495 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:50.782073  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 85311.8us
W20260709 12:15:50.782785  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 136263us
I20260709 12:15:50.659299  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:50.783725  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 51781us
I20260709 12:15:50.661549  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.677958  9536 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.658941  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.665666  9245 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:50.647747  8443 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:50.792310  8331 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:50.792941  8369 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.674474  8475 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:50.798848  8403 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
W20260709 12:15:50.850023  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 57182.5us
I20260709 12:15:50.799258  8255 raft_consensus.cc:2376] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3. Re-sending same reply.
I20260709 12:15:50.852586  8404 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:50.822059  8155 catalog_manager.cc:5697] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 3 to 4, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 4 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.854405  8332 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:50.670504  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.848914  8372 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:50.670663  9538 consensus_queue.cc:1048] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:15:50.793040  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:50.674839  9603 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:50.663496  9289 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:50.873826  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.797191  9586 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:50.822229  9636 log.cc:927] Time spent T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:15:50.816231  9129 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:50.866634  8155 catalog_manager.cc:5697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 35617b9c10ad4daa80878f0de881422c (127.3.34.196). New cstate: current_term: 2 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:50.787348  8476 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:15:50.672781  9525 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:50.884097  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:50.861397  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 192111us
I20260709 12:15:50.859010  9518 raft_consensus.cc:2804] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:50.674965  9604 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:50.886615  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 74952.2us
I20260709 12:15:50.890733  9296 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:50.826879  8250 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:50.832511  8397 raft_consensus.cc:1275] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:50.673858  9581 consensus_queue.cc:1048] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 12:15:50.894737  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.928143  8331 raft_consensus.cc:2368] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4.
I20260709 12:15:50.875499  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:50.877935  8445 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:50.814877  8400 raft_consensus.cc:1240] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:50.818637  8401 raft_consensus.cc:1240] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:50.815454  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.857682  9536 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:50.821364  9606 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:50.933229  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 55399.7us
I20260709 12:15:50.892761  8297 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:50.938748  8370 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:50.665457  9624 consensus_queue.cc:1048] T 61fe6595501f4c619d61dedd4c8eb8b5 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.192s
I20260709 12:15:50.897428  8324 raft_consensus.cc:2410] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:50.906843  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:50.905625  8220 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:50.944664  8255 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:50.920615  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 71820.9us
I20260709 12:15:50.898316  9586 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:50.906100  9093 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:50.900985  9616 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:50.900713  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.788913  8473 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
W20260709 12:15:50.942574  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.875658  9495 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:50.892519  9584 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:15:50.929899  8329 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 3: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
W20260709 12:15:50.961376  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 503424us
I20260709 12:15:50.946283  9622 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:50.996541  8255 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:50.990504  9548 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:51.008234  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.008627  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.009126  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:51.010673  9640 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:51.011253  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.011541  9525 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.012063  8323 raft_consensus.cc:2410] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:51.012989  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.013716  8323 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:51.015319  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.016041  8475 raft_consensus.cc:3060] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:50.986477  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:50.925688  9609 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:50.955456  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.959362  9586 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:50.956082  9342 consensus_queue.cc:1059] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:15:50.966356  8327 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:51.004772  9622 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:50.968122  9635 log.cc:927] Time spent T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:15:50.968644  8372 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:50.969527  9129 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:50.928301  9518 raft_consensus.cc:697] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:50.971462  9604 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:50.971741  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:50.974273  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 49109.8us
W20260709 12:15:50.974766  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 69189.3us
I20260709 12:15:50.976771  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:50.930881  8399 raft_consensus.cc:1240] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:50.897907  9633 consensus_queue.cc:1059] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:15:50.930413  9249 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:50.935859  8398 raft_consensus.cc:1275] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:50.959925  9245 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:50.960033  9522 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:51.019227  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 126543us
I20260709 12:15:50.962568  8332 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:51.023449  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 74816.7us
I20260709 12:15:50.962771  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.975399  9608 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:50.975781  9616 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:51.041780  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:50.965149  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.014912  8323 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:50.955713  9638 consensus_queue.cc:1048] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.098s
I20260709 12:15:51.069296  8329 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:51.070390  9495 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.061458  9622 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.071363  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.108983  8370 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:51.060017  8325 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:51.141364  9616 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.047933  9511 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:51.049450  9647 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:51.147883  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 67708.8us
I20260709 12:15:51.078105  9606 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.124571  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:51.167955  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.177942  8397 raft_consensus.cc:2393] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:51.178848  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.179060  9651 consensus_queue.cc:1059] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:15:51.171597  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:51.180189  9651 raft_consensus.cc:3055] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:51.180378  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.180610  9651 raft_consensus.cc:740] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:51.181183  8473 raft_consensus.cc:2368] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:15:51.181475  9651 consensus_queue.cc:260] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.050980  9609 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.183333  8327 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:51.184667  8327 raft_consensus.cc:1240] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:51.186165  8327 raft_consensus.cc:1275] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:15:51.163102  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 112176us
W20260709 12:15:51.164572  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 156877us
W20260709 12:15:51.147599  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 67970.8us
W20260709 12:15:51.174111  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:51.085470  9414 raft_consensus.cc:697] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:51.175328  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 66454.4us
I20260709 12:15:51.124878  9245 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.143841  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.161237  9249 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.182752  9651 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:51.190142  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 330391us
I20260709 12:15:51.193287  8221 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.060701  9022 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.198891  8331 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
W20260709 12:15:51.224767  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 55725.8us
I20260709 12:15:51.144294  9522 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.160830  8328 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:51.169468  9647 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.143222  9605 consensus_queue.cc:1059] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:15:51.205242  8446 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:51.208173  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.192672  9601 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:51.202344  8297 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.230919  8445 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.204734  8324 raft_consensus.cc:2410] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:51.213124  8221 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.200245  9245 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:51.253413  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 51149.4us
I20260709 12:15:51.192138  9511 consensus_queue.cc:1059] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:15:51.224562  9299 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.254257  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:51.255437  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:51.255787  8331 raft_consensus.cc:1275] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:51.257028  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:51.257448  8221 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:51.229097  9389 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:51.260875  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 55719.4us
I20260709 12:15:51.194016  9606 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.264124  8369 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:51.249181  9601 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:51.265688  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 297114us
I20260709 12:15:51.246364  9647 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.206704  9536 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.224665  9249 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.254262  9129 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.267795  8297 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:51.269237  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.254633  9526 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.254601  9548 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:51.255568  9289 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.259317  9603 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.280881  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:51.289026  8471 raft_consensus.cc:1240] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:51.289129  9657 consensus_queue.cc:1059] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:15:51.273308  9601 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.273948  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.291168  9610 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:51.256438  9509 consensus_queue.cc:1059] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:15:51.291746  9643 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:15:51.266630  9414 consensus_queue.cc:237] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:51.249871  9518 consensus_queue.cc:237] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.295164  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.296051  9548 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:51.372316  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 114938us
I20260709 12:15:51.302490  8296 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.254878  9581 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:15:51.304019  8474 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:51.342897  8331 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:51.305332  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:51.344951  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 64396.3us
I20260709 12:15:51.290218  9642 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:51.272095  9299 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.290575  9650 consensus_queue.cc:1059] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 12:15:51.360198  8405 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:51.280776  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.280279  9226 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:51.342334  9608 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:51.296954  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:51.374022  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 113846us
W20260709 12:15:51.305214  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.304996  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:51.289026  9654 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:51.358664  9646 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:51.359159  8476 raft_consensus.cc:1240] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:51.376832  8221 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:51.380455  8220 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:51.387192  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 119453us
I20260709 12:15:51.341487  9129 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:51.402056  9661 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:51.402305  9129 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:51.402707  9661 raft_consensus.cc:697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:51.403275  9129 raft_consensus.cc:2749] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:51.403700  9661 consensus_queue.cc:237] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.404295  8297 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.404951  9584 raft_consensus.cc:3055] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:51.405405  9584 raft_consensus.cc:740] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:51.407863  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.409193  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.410307  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.411187  9129 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:51.412019  9129 consensus_queue.cc:1059] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:51.413058  9129 raft_consensus.cc:3055] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:51.413400  9129 raft_consensus.cc:740] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:51.414184  9129 consensus_queue.cc:260] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:51.370834  8473 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
W20260709 12:15:51.415227  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.415478  9129 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:51.375192  9548 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.392472  8331 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:51.295185  9653 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:15:51.399840  9660 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:15:51.379367  9642 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:51.449992  8478 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
W20260709 12:15:51.451099  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 104741us
I20260709 12:15:51.393374  9296 raft_consensus.cc:3055] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:15:51.457919  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 83332.5us
I20260709 12:15:51.457875  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:51.461650  8221 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.420011  8472 raft_consensus.cc:2468] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:51.460680  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.420444  8327 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:51.415851  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.427490  9548 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.420118  8475 raft_consensus.cc:2468] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:51.455808  9650 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:15:51.477020  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 100065us
I20260709 12:15:51.454902  9642 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.450695  9666 raft_consensus.cc:3055] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:51.461082  9296 raft_consensus.cc:740] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:51.457368  9646 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:51.476805  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.479466  9668 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:15:51.480334  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 177926us
I20260709 12:15:51.464912  9638 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:51.483493  8473 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:51.485153  8471 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:15:51.491432  9022 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.491966  9676 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:51.492179  8476 raft_consensus.cc:1240] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
I20260709 12:15:51.492830  9299 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.493671  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.494140  8472 raft_consensus.cc:1275] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:51.495339  9659 raft_consensus.cc:3055] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:51.533623  9659 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:51.534621  9659 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.536998  9659 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:51.519259  9646 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.541105  9646 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.525650  8471 pending_rounds.cc:85] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Aborting all ops after (but not including) 2
I20260709 12:15:51.463609  9608 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:51.419678  9654 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.477624  9650 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:51.558583  9650 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.560037  9522 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.531646  9606 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:51.491477  9536 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.508908  9666 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:51.567508  9389 raft_consensus.cc:3055] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:51.567158  9666 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.567955  9389 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:51.568536  9666 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.568778  9389 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:51.569180  9647 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:51.570070  9389 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:51.544445  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.571478  9604 raft_consensus.cc:3055] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:51.571877  9604 raft_consensus.cc:740] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:51.572009  8443 leader_election.cc:336] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513): Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 1.572s (SENT)
I20260709 12:15:51.572477  8443 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.572764  9604 consensus_queue.cc:260] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.475411  8221 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:51.574885  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 99564.6us
I20260709 12:15:51.552218  8298 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:51.553640  9249 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.469404  9584 consensus_queue.cc:260] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.577755  8221 leader_election.cc:400] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6.
I20260709 12:15:51.554227  9608 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.581818  8221 leader_election.cc:403] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:15:51.579497  9647 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.590075  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.593328  9584 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:51.595084  8328 raft_consensus.cc:1275] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:51.586392  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.586716  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.587658  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.600397  9638 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6.
I20260709 12:15:51.600975  8250 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:51.602284  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.609417  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.610303  8475 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:51.588881  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 421) took 1479 ms. Trace:
I20260709 12:15:51.551142  8471 pending_rounds.cc:107] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:15:51.589267  8249 raft_consensus.cc:1275] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:51.586455  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.628159  8369 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:51.634562  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.635263  8256 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:51.635886  8221 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.643059  8403 raft_consensus.cc:1240] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:51.560037  9654 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.628784  8471 raft_consensus.cc:2889] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:51.641407  9647 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:51.583588  9536 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:15:51.640133  9652 log.cc:927] Time spent T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:15:51.628065  9606 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:15:51.650247  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:51.693086  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.701035  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:51.702703  8331 raft_consensus.cc:1275] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:51.585769  9604 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.654016  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:51.550897  9660 consensus_queue.cc:1048] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:15:51.711318  8257 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:51.712723  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:51.657223  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.649979  8406 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:51.663618  9536 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:51.664634  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.664778  9548 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.671195  9626 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.648734  9495 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:51.677414  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.649077  9522 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:51.679859  9622 consensus_meta.cc:287] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:15:51.652907  9249 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:15:51.681860  9644 log.cc:927] Time spent T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:15:51.682559  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.751762  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:51.652617  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:51.626813  8399 rpcz_store.cc:276] 0709 12:15:50.109360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.111138 (+  1778us) service_pool.cc:224] Handling call
0709 12:15:50.354430 (+243292us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:50.354660 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:51.083760 (+729100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.588624 (+504864us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540004ced4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:51.588813 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320450176}
I20260709 12:15:51.766886  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:51.722971  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:51.725706  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.767743  8480 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.543604  9676 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:51.774282  9651 consensus_meta.cc:287] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.006s
I20260709 12:15:51.774492  9676 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:51.775213  9414 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:51.744755  9626 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
PC: @                0x0 (unknown)
I20260709 12:15:51.775820  9414 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:51.776163  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.777042  8330 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:51.778302  9414 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.778445  9626 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:51.779867  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:51.781260  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.784658  8475 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:51.662246  9654 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:51.552469  9296 consensus_queue.cc:260] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:51.730931  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 98013.9us
W20260709 12:15:51.740513  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 188403us
I20260709 12:15:51.743415  9638 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:51.744959  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 324499us
W20260709 12:15:51.724229  8252 consensus_meta.cc:287] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
I20260709 12:15:51.687386  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:51.761011  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:52.071336  8478 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:51.728459  8472 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:51.721400  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:51.744545  9586 consensus_meta.cc:287] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 12:15:51.768225  8332 raft_consensus.cc:2376] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5. Re-sending same reply.
I20260709 12:15:51.770402  9536 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.753273  9522 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:51.784725  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:51.786345  9548 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:51.786594  8328 raft_consensus.cc:1275] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:51.730048  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:51.745260  9609 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:51.795709  8480 raft_consensus.cc:2468] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:51.810752  8296 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:51.752380  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:51.764598  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 275) took 1091 ms. Trace:
I20260709 12:15:51.752847  8249 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:51.824293  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 250604us
I20260709 12:15:51.766225  9249 raft_consensus.cc:697] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:51.760722  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:51.746624  9495 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:52.059413  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:51.863189  9654 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.096552  8328 pending_rounds.cc:85] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 1
W20260709 12:15:52.059995  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 215087us
I20260709 12:15:51.761735  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:51.892896  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:52.161329  8297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.039s	sys 0.052s
W20260709 12:15:52.161762  8297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.039s	sys 0.052s
I20260709 12:15:51.866029  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:51.799059  8397 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:51.938040  8254 raft_consensus.cc:2410] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:15:52.074571  8405 consensus_meta.cc:287] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.002s
I20260709 12:15:52.169723  8405 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:52.075340  8257 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:52.083758  8372 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:52.086112  8330 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:52.076038  9616 consensus_meta.cc:287] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.885s	user 0.010s	sys 0.004s
I20260709 12:15:52.097302  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:52.075011  9651 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:15:52.083127  9666 consensus_meta.cc:287] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.514s	user 0.015s	sys 0.000s
W20260709 12:15:52.083499  9129 consensus_meta.cc:287] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.003s
I20260709 12:15:52.074972  9638 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.074205  9660 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:52.085168  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.081926  9683 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:52.072058  8252 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:52.129906  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 319242us
I20260709 12:15:52.235749  8296 leader_election.cc:400] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:15:52.132123  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:52.243568  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 159879us
I20260709 12:15:52.248687  8296 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:51.751714  9622 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.143188  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:52.152729  8478 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:52.085029  9518 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.174472  9610 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.142225  8328 pending_rounds.cc:107] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:52.119622  9609 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.118664  9676 raft_consensus.cc:2749] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:52.255333  9129 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:52.087241  9586 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.168411  9389 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.118935  8329 raft_consensus.cc:2376] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4. Re-sending same reply.
W20260709 12:15:52.083377  9642 consensus_meta.cc:287] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
I20260709 12:15:52.144233  9022 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:52.200280  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.232638  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:52.256297  8372 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:52.227185  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:52.298388  8331 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.215744  8476 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:52.214869  9658 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.255510  8256 raft_consensus.cc:2410] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 12:15:52.284127  9650 consensus_meta.cc:287] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
W20260709 12:15:52.232219  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.214119  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.287951  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:52.186970  9616 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.351372  8332 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:52.257278  8221 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:52.432693  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 175526us
I20260709 12:15:52.233460  8324 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:52.243721  8326 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:52.257144  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 284) took 1193 ms. Trace:
I20260709 12:15:52.288173  9610 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.385582  8479 raft_consensus.cc:2368] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:52.291059  8328 raft_consensus.cc:2889] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:52.221835  9666 consensus_queue.cc:1048] T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 12:15:52.237655  9522 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.292580  9651 raft_consensus.cc:697] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:52.425737  8404 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:52.305769  9586 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:52.294592  9226 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:15:52.283209  9688 log.cc:927] Time spent T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:15:52.495930  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:52.434162  8221 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:52.352381  9604 consensus_meta.cc:287] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.005s
I20260709 12:15:52.432197  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:52.305119  9638 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.321725  9681 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.296828  9518 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.307138  9495 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.334916  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:52.536847  8406 raft_consensus.cc:2410] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:52.538344  9693 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:52.538882  9676 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.540141  8331 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
W20260709 12:15:52.595484  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.227406  9660 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.295504  9609 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:52.568811  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 134716us
W20260709 12:15:52.600517  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.600458  8221 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:52.426203  8325 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:52.496438  9639 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:52.300644  9249 consensus_queue.cc:237] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.580267  9647 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:52.240567  9683 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:52.522702  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 274117us
W20260709 12:15:52.537768  9601 consensus_meta.cc:287] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 1.166s	user 0.015s	sys 0.012s
W20260709 12:15:52.533993  9245 consensus_meta.cc:287] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 1.265s	user 0.016s	sys 0.000s
W20260709 12:15:52.581997  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 399949us
I20260709 12:15:52.582181  9548 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:52.516427  8327 consensus_meta.cc:287] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 1.039s	user 0.016s	sys 0.000s
W20260709 12:15:52.585026  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 453002us
I20260709 12:15:52.543833  9702 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.303900  9389 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.308190  9129 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.358665  9022 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.622651  9638 raft_consensus.cc:2804] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:52.424350  9658 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.358796  9642 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.566159  9522 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.432085  9650 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.538416  9699 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:52.575136  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:52.573753  8330 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
W20260709 12:15:52.615916  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:52.618166  9622 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.516340  8252 rpcz_store.cc:276] 0709 12:15:51.052919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.059681 (+  6762us) service_pool.cc:224] Handling call
0709 12:15:52.246661 (+1186980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.638569  8404 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:52.610606  9608 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:52.518555  8250 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:52.614148  9495 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.595503  9586 consensus_queue.cc:1048] T 300320f772ad478099f8979d4543de23 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:15:52.655674  8443 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:52.658545  8327 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
W20260709 12:15:52.671309  9692 log.cc:927] Time spent T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 12:15:52.593611  9681 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.642505  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:52.604027  9676 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:52.718420  9698 log.cc:927] Time spent T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:15:52.721529  8328 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:52.723035  8328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 402) took 1013 ms. Trace:
I20260709 12:15:52.654585  9687 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.723845  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.724344  9687 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.724920  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:52.726608  8397 raft_consensus.cc:1275] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:52.626750  9679 consensus_queue.cc:1059] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:15:52.680811  9699 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:52.727221  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 400) took 1018 ms. Trace:
W20260709 12:15:52.685112  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 428884us
I20260709 12:15:52.684911  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:52.645483  9639 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.720857  8332 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:52.692056  8255 raft_consensus.cc:1240] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:52.729266  9639 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.731451  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.732026  9676 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:52.683982  8330 raft_consensus.cc:1240] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:52.732899  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.718927  9389 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.733919  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.734254  9389 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.734812  9389 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.728330  8372 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:52.736806  9642 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.680330  9638 raft_consensus.cc:697] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:52.737291  8446 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:52.738756  9650 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.680951  9522 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:52.692147  9659 consensus_meta.cc:287] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 1.155s	user 0.014s	sys 0.000s
I20260709 12:15:52.643478  9601 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.762269  8326 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:52.787837  9601 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.788033  9666 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:52.788492  9601 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.788758  9666 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.683982  9700 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:52.721941  8327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 169) took 1455 ms (client timeout 1761 ms). Trace:
I20260709 12:15:52.789361  9666 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.789655  9700 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.647866  9548 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.705739  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:52.790825  8402 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:52.732110  9639 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:52.791221  8475 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:52.721262  9022 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:52.791399  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 135832us
I20260709 12:15:52.792038  9642 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:52.792346  8443 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:52.792635  9642 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.718736  9673 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.734850  8249 raft_consensus.cc:2393] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:52.738428  9638 consensus_queue.cc:237] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.794971  9642 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.795276  9673 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.721238  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.106817  8248 rpcz_store.cc:276] 0709 12:15:50.668958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.671928 (+  2970us) service_pool.cc:224] Handling call
0709 12:15:50.672302 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:50.973310 (+301008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:50.973360 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:50.973959 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:15:51.224482 (+250523us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:51.263000 (+ 38518us) log.cc:844] Serialized 14 byte log entry
0709 12:15:51.305673 (+ 42673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.565648 (+259975us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b1800147ee0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:15:51.591966 (+ 26318us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400515754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:51.592050 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:51.740443 (+148393us) raft_consensus.cc:1685] finished
0709 12:15:51.745234 (+  4791us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:51.752571 (+  7337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101705,"prepare.queue_time_us":26338,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":118126,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":29382,"spinlock_wait_cycles":577922048,"thread_start_us":250061,"threads_started":1,"wal-append.queue_time_us":285096}
I20260709 12:15:52.800392  9673 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.740649  9687 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.719769  9609 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.740849  8474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 316) took 1133 ms. Trace:
I20260709 12:15:52.801015  8248 raft_consensus.cc:1275] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:52.741433  9616 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.732928  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 403) took 1023 ms. Trace:
I20260709 12:15:52.795845  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 239) took 1121 ms. Trace:
I20260709 12:15:52.802208  8330 rpcz_store.cc:276] 0709 12:15:51.709971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.683423 (+973452us) service_pool.cc:224] Handling call
0709 12:15:52.683761 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:52.732653 (+ 48892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.732857 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.802357  8249 rpcz_store.cc:276] 0709 12:15:51.673980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.733610 (+1059630us) service_pool.cc:224] Handling call
0709 12:15:52.795775 (+ 62165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.804180  8249 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:52.804250  8330 raft_consensus.cc:1275] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:52.796731  9700 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.805056  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 405) took 1093 ms. Trace:
I20260709 12:15:52.728740  8480 raft_consensus.cc:2468] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:52.675523  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 171) took 1415 ms. Trace:
I20260709 12:15:52.734673  8252 raft_consensus.cc:1275] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:52.806161  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 237) took 1132 ms. Trace:
I20260709 12:15:52.806449  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:52.738462  8446 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:52.690060  8253 raft_consensus.cc:2376] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2. Re-sending same reply.
I20260709 12:15:52.806860  9683 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.727674  8325 rpcz_store.cc:276] 0709 12:15:51.709148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.655717 (+946569us) service_pool.cc:224] Handling call
0709 12:15:52.685468 (+ 29751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.693825 (+  8357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.699628 (+  5803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.702590 (+  2962us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:52.714608 (+ 12018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.719252 (+  4644us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.727156 (+  7904us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:52.807367  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 68978.3us
I20260709 12:15:52.806937  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 178) took 1134 ms. Trace:
I20260709 12:15:52.808238  8252 rpcz_store.cc:276] 0709 12:15:51.672484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.733986 (+1061502us) service_pool.cc:224] Handling call
0709 12:15:52.734309 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.806648 (+ 72339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.806874 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.808844  8325 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:15:52.809329  8253 raft_consensus.cc:1275] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:52.809553  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 406) took 1097 ms. Trace:
I20260709 12:15:52.806773  8249 rpcz_store.cc:276] 0709 12:15:51.673475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.803458 (+1129983us) service_pool.cc:224] Handling call
0709 12:15:52.803816 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.804625 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.806084 (+  1459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.811391  9654 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.811492  9658 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.806005  8323 rpcz_store.cc:276] 0709 12:15:51.253245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.254462 (+  1217us) service_pool.cc:224] Handling call
0709 12:15:51.773300 (+518838us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:51.773494 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:51.773749 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:52.091359 (+317610us) log.cc:844] Serialized 14 byte log entry
0709 12:15:52.613195 (+521836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.622390 (+  9195us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:52.634979 (+ 12589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.644835 (+  9856us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.660600 (+ 15765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37860,"prepare.queue_time_us":322255,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":5642,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12562,"spinlock_wait_cycles":13369088,"thread_start_us":702134,"threads_started":2,"wal-append.queue_time_us":557383}
I20260709 12:15:52.660111  9702 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.813346  8297 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:52.794734  8443 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:52.815155  8480 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:52.818183  8332 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:52.727694  9699 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:52.741225  9389 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:52.668099  9651 consensus_queue.cc:237] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:52.789779  8327 rpcz_store.cc:269] 0709 12:15:51.250465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.258212 (+  7747us) service_pool.cc:224] Handling call
0709 12:15:52.705862 (+1447650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.735122  9226 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:52.739017  9661 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.643710  9245 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.723553  8328 rpcz_store.cc:276] 0709 12:15:51.709704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.667911 (+958207us) service_pool.cc:224] Handling call
0709 12:15:52.705731 (+ 37820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:52.722627 (+ 16896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.722913 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.741178  9681 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.801781  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 236) took 1128 ms. Trace:
I20260709 12:15:52.789023  9601 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.754590  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 235) took 1081 ms. Trace:
I20260709 12:15:52.805675  8330 rpcz_store.cc:276] 0709 12:15:51.711632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.803586 (+1091954us) service_pool.cc:224] Handling call
0709 12:15:52.803914 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.804817 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.805003 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.784261  8331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 399) took 1075 ms. Trace:
I20260709 12:15:52.764955  9622 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.810102  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 238) took 1136 ms. Trace:
I20260709 12:15:52.860049  9660 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.783896  9707 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:52.801412  8474 rpcz_store.cc:276] 0709 12:15:51.607514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.638473 (+ 30959us) service_pool.cc:224] Handling call
0709 12:15:51.679794 (+ 41321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:51.680257 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:51.680291 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:51.680916 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:15:51.874874 (+193958us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:51.882578 (+  7704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.891472 (+  8894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:52.740590 (+849118us) raft_consensus.cc:1685] finished
0709 12:15:52.740619 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.740780 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121,"thread_start_us":118254,"threads_started":1,"wal-append.queue_time_us":972944}
I20260709 12:15:52.832788  9678 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.845834  8257 rpcz_store.cc:276] 0709 12:15:51.672997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.753516 (+1080519us) service_pool.cc:224] Handling call
0709 12:15:52.753944 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.754167 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.754204 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.754261 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:52.754328 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.754393 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.754511 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.822834  9683 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:52.868930  8257 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:52.854629  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 291) took 1093 ms. Trace:
I20260709 12:15:52.855918  9610 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.814553  9129 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.812326  9658 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:52.859563  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:52.847452  8331 rpcz_store.cc:276] 0709 12:15:51.708713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.604546 (+895833us) service_pool.cc:224] Handling call
0709 12:15:52.604851 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.605053 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:52.627385 (+ 22332us) log.cc:844] Serialized 14 byte log entry
0709 12:15:52.783842 (+156457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.783909 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:52.783965 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.784049 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.784193 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38233,"raft.queue_time_us":326,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":12525312,"thread_start_us":132791,"threads_started":1}
I20260709 12:15:52.862066  8404 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:52.700134  9495 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.898953  9495 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.860430  9622 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.901932  9622 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:52.810057  8325 rpcz_store.cc:276] 0709 12:15:51.711926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.808082 (+1096156us) service_pool.cc:224] Handling call
0709 12:15:52.808429 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.809283 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.809489 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.873287  8251 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:52.871176  9678 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:52.874847  9702 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:52.875272  8474 raft_consensus.cc:1275] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:15:52.875931  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.876561  8400 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:52.878969  9522 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:52.860414  8253 rpcz_store.cc:276] 0709 12:15:51.673725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.808601 (+1134876us) service_pool.cc:224] Handling call
0709 12:15:52.808922 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.809799 (+   877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.810040 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.880976  9601 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.881804  9707 raft_consensus.cc:697] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:52.884038  9245 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:52.932273  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 169068us
I20260709 12:15:52.887598  8326 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:52.888396  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 318) took 1280 ms. Trace:
I20260709 12:15:52.878875  9226 raft_consensus.cc:2749] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:52.888988  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 323) took 1276 ms. Trace:
I20260709 12:15:52.889469  9683 raft_consensus.cc:697] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:52.870776  9518 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:52.843585  8248 rpcz_store.cc:276] 0709 12:15:51.673238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.800237 (+1126999us) service_pool.cc:224] Handling call
0709 12:15:52.800632 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.801479 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.801718 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:52.892763  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 83986.9us
I20260709 12:15:52.782773  9647 raft_consensus.cc:697] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:52.892704  9643 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.894662  9720 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.893854  9658 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.904124  9608 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.923736  8475 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:52.844679  9661 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.904826  9703 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:52.894672  9681 consensus_queue.cc:1048] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.031s
W20260709 12:15:52.941004  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:52.924485  9702 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:52.961354  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 166691us
I20260709 12:15:52.975873  9706 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:52.872386  8250 rpcz_store.cc:276] 0709 12:15:51.761430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.853591 (+1092161us) service_pool.cc:224] Handling call
0709 12:15:52.853985 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.854223 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.854252 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.854306 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:52.854343 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.854407 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.854560 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:52.942808  8473 rpcz_store.cc:276] 0709 12:15:51.608255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.639891 (+ 31636us) service_pool.cc:224] Handling call
0709 12:15:51.718501 (+ 78610us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:51.763467 (+ 44966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:51.766025 (+  2558us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:51.769693 (+  3668us) log.cc:844] Serialized 52 byte log entry
0709 12:15:51.822568 (+ 52875us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:51.822780 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.823216 (+   436us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:52.865520 (+1042304us) raft_consensus.cc:1685] finished
0709 12:15:52.865551 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.888291 (+ 22740us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1588,"thread_start_us":51724,"threads_started":1,"wal-append.queue_time_us":934579}
I20260709 12:15:53.019464  8402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54490 (request call id 432) took 1389 ms. Trace:
I20260709 12:15:52.983703  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.961517  9727 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:15:52.992398  8372 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:53.029533  8372 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:52.993140  9707 consensus_queue.cc:237] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.995093  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 168) took 1411 ms. Trace:
I20260709 12:15:52.996922  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 407) took 1265 ms. Trace:
I20260709 12:15:52.998097  8478 raft_consensus.cc:1275] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:52.967075  9658 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:52.959349  9687 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.998409  9661 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.000048  9647 consensus_queue.cc:237] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.000682  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:52.967413  9720 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.001304  9683 consensus_queue.cc:237] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.962389  9643 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:52.979588  9608 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:52.985111  9703 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:52.973690  9666 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.007390  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:52.987985  9296 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:52.984314  9536 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:53.009789  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.111533  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 76294.4us
I20260709 12:15:52.959939  9129 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.020102  8402 rpcz_store.cc:276] 0709 12:15:51.630557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.759348 (+128791us) service_pool.cc:224] Handling call
0709 12:15:53.019241 (+1259893us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004ba854. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.019399 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323062016}
I20260709 12:15:53.031147  9702 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.032413  9633 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.080201  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 290) took 1386 ms. Trace:
I20260709 12:15:53.036808  8443 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:53.137916  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 101222us
I20260709 12:15:53.138733  8443 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:53.077950  9509 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:53.043494  8477 raft_consensus.cc:1275] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.043313  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.009663  9610 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.044868  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 410) took 1234 ms. Trace:
I20260709 12:15:53.076498  9681 consensus_queue.cc:1059] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:52.946017  8471 rpcz_store.cc:276] 0709 12:15:51.613051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.764686 (+151635us) service_pool.cc:224] Handling call
0709 12:15:52.071064 (+306378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.226928 (+155864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.232858 (+  5930us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.244442 (+ 11584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:52.255931 (+ 11489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.888632 (+632701us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540018ecd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:52.888711 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.888907 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304695168}
I20260709 12:15:53.081881  9687 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:53.111440  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 58588.9us
W20260709 12:15:53.078965  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.032123  8479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 169) took 2028 ms (client timeout 2171 ms). Trace:
W20260709 12:15:53.120432  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.159747  8479 rpcz_store.cc:269] 0709 12:15:50.994800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:50.995243 (+   443us) service_pool.cc:224] Handling call
0709 12:15:53.022594 (+2027351us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540023d2d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.022805 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3158451456}
I20260709 12:15:53.160234  9622 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:53.121336  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.032204  9586 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:53.123413  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.123217  9646 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:53.124927  9633 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.125665  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.133421  9548 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:53.137787  9661 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:53.142455  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 289) took 1465 ms. Trace:
W20260709 12:15:53.143333  8472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 174) took 1568 ms (client timeout 1524 ms). Trace:
I20260709 12:15:53.144536  8324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 397) took 1436 ms. Trace:
I20260709 12:15:53.145026  9702 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.146955  9720 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.124346  9129 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.150009  9643 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:53.151115  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.166535  9646 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.176215  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.176643  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.177102  8400 raft_consensus.cc:2393] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 3: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:53.177809  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.152801  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 175) took 1023 ms. Trace:
I20260709 12:15:53.172192  8250 raft_consensus.cc:2376] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5. Re-sending same reply.
I20260709 12:15:53.179145  8330 rpcz_store.cc:276] 0709 12:15:52.129697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.865349 (+735652us) service_pool.cc:224] Handling call
0709 12:15:52.880438 (+ 15089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:52.880858 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.880895 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:52.881555 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 12:15:53.047309 (+165754us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:53.047375 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.047482 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:53.152619 (+105137us) raft_consensus.cc:1685] finished
0709 12:15:53.152634 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.152750 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":165258,"threads_started":1,"wal-append.queue_time_us":256258}
I20260709 12:15:53.166294  9610 consensus_queue.cc:1048] T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:15:53.153576  8332 rpcz_store.cc:276] 0709 12:15:51.810266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.431969 (+621703us) service_pool.cc:224] Handling call
0709 12:15:53.044645 (+612676us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540047d1d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.044792 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347323648}
I20260709 12:15:53.171871  8324 rpcz_store.cc:276] 0709 12:15:51.708074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.710980 (+  2906us) service_pool.cc:224] Handling call
0709 12:15:51.781110 (+ 70130us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:53.144286 (+1363176us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400226354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.144456 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030263936}
I20260709 12:15:53.122370  9536 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.182721  9633 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.183440  9536 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:53.184569  9691 log.cc:927] Time spent T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.540s	user 0.001s	sys 0.000s
I20260709 12:15:53.185156  9129 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:53.163182  9586 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.161123  9681 consensus_queue.cc:1243] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer b3421ee20b674b879e0633e39c5709d7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:53.194422  9651 raft_consensus.cc:3055] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:53.160760  9622 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:53.195241  9622 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:53.196206  9703 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.198174  9658 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.189072  9610 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.198607  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 404) took 1487 ms. Trace:
I20260709 12:15:53.199744  8332 raft_consensus.cc:1275] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.199296  9610 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.200516  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.170547  8252 rpcz_store.cc:276] 0709 12:15:51.677376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.809121 (+1131745us) service_pool.cc:224] Handling call
0709 12:15:52.809435 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.809712 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:52.930406 (+120694us) log.cc:844] Serialized 14 byte log entry
0709 12:15:53.119967 (+189561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:53.122921 (+  2954us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:53.123486 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.141363 (+ 17877us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.142382 (+  1019us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178061,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1018,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2253,"thread_start_us":275855,"threads_started":2,"wal-append.queue_time_us":233819}
I20260709 12:15:53.201810  9610 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.202103  8443 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:53.195168  9586 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.202693  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.203578  8325 raft_consensus.cc:2393] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:53.204440  9661 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:53.206863  9633 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:53.208829  8443 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:53.212505  9699 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
*** SIGABRT (@0x3e800000c8b) received by PID 3211 (TID 0x7f1246c33840) from PID 3211; stack trace: ***
    @           0x2d4280 __tsan::CallUserSignalHandler() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
    @           0x2d6763 rtl_sigaction() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
I20260709 12:15:53.168036  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.260241  8257 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.261569  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 287) took 1786 ms. Trace:
I20260709 12:15:53.261965  8255 rpcz_store.cc:276] 0709 12:15:51.475103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.475254 (+   151us) service_pool.cc:224] Handling call
0709 12:15:51.485908 (+ 10654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.730119 (+1244211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.261334 (+531215us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540026b454. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:53.261508 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2773308160}
I20260709 12:15:53.264730  9699 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.051393  8254 rpcz_store.cc:276] 0709 12:15:51.584104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.586126 (+  2022us) service_pool.cc:224] Handling call
0709 12:15:52.994826 (+1408700us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400268254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:52.995031 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356174592}
W20260709 12:15:53.170116  8472 rpcz_store.cc:269] 0709 12:15:51.575322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.576806 (+  1484us) service_pool.cc:224] Handling call
0709 12:15:53.143060 (+1566254us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400133154. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.143242 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273014656}
I20260709 12:15:53.161293  9414 consensus_queue.cc:1048] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:15:53.265844  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.265978  9414 consensus_queue.cc:1243] T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer 70ae764f2abd44229023295f5cc6bf37 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:15:53.266512  8254 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:53.267668  9414 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.268337  9414 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.269969  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.182729  9678 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.190918  8401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 433) took 1560 ms. Trace:
W20260709 12:15:53.191073  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.192478  9687 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.194823  9651 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:53.202196  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.178215  9646 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.213649  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.213979  8220 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:53.215982  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.180042  8398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 431) took 1550 ms. Trace:
I20260709 12:15:53.216711  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.216660  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:53.217386  8405 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54490 (request call id 427) took 1961 ms (client timeout 1783 ms). Trace:
I20260709 12:15:53.216619  9509 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.177881  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.219746  8325 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.220906  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.222015  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 171) took 1636 ms. Trace:
I20260709 12:15:53.222410  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:53.277565  8405 rpcz_store.cc:269] 0709 12:15:51.256220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.256349 (+   129us) service_pool.cc:224] Handling call
0709 12:15:53.217216 (+1960867us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003d7554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.217325 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231591680}
I20260709 12:15:53.290280  8332 raft_consensus.cc:2393] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 2: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:53.223452  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.223678  8248 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:53.226552  9658 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.226951  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 241) took 1552 ms. Trace:
I20260709 12:15:53.298831  8256 rpcz_store.cc:276] 0709 12:15:51.674490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.722649 (+ 48159us) service_pool.cc:224] Handling call
0709 12:15:53.226754 (+1504105us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400516b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.226894 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095039232}
I20260709 12:15:53.216557  9633 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:53.227694  9706 consensus_queue.cc:1048] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.228865  8443 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:53.229650  9696 log.cc:927] Time spent T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.438s	user 0.001s	sys 0.001s
W20260709 12:15:53.230626  9684 log.cc:927] Time spent T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 1.148s	user 0.009s	sys 0.001s
I20260709 12:15:53.232053  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.236248  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.238283  9622 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.227751  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.278158  8400 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:53.273602  8252 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.251471  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:53.076862  8323 rpcz_store.cc:276] 0709 12:15:51.731219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.832913 (+1101694us) service_pool.cc:224] Handling call
0709 12:15:52.852579 (+ 19666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:52.857186 (+  4607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.857227 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:52.857909 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 12:15:52.938280 (+ 80371us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:52.944907 (+  6627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.951760 (+  6853us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:52.996693 (+ 44933us) raft_consensus.cc:1685] finished
0709 12:15:52.996711 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:52.996861 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3961,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":69315,"threads_started":1,"wal-append.queue_time_us":104571}
I20260709 12:15:53.199290  8329 rpcz_store.cc:276] 0709 12:15:51.711320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.803930 (+1092610us) service_pool.cc:224] Handling call
0709 12:15:52.804305 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:52.804766 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.804799 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:52.805493 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 12:15:52.942793 (+137300us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:52.944862 (+  2069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:52.951690 (+  6828us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:53.198344 (+246654us) raft_consensus.cc:1685] finished
0709 12:15:53.198370 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.198543 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":651,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":117767,"threads_started":1,"wal-append.queue_time_us":229259}
I20260709 12:15:53.137308  8249 rpcz_store.cc:276] 0709 12:15:51.692771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:52.811342 (+1118571us) service_pool.cc:224] Handling call
0709 12:15:52.811682 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.811920 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:15:52.908583 (+ 96663us) log.cc:844] Serialized 14 byte log entry
0709 12:15:52.968067 (+ 59484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.983094 (+ 15027us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:53.002328 (+ 19234us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180039d600. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:15:53.010255 (+  7927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.031621 (+ 21366us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.079380 (+ 47759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4576,"prepare.queue_time_us":176465,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":4392,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"spinlock_wait_cycles":30328704,"thread_start_us":124247,"threads_started":2,"wal-append.queue_time_us":124295}
I20260709 12:15:53.255759  9709 raft_consensus.cc:3055] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:53.278761  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:53.352303  8298 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:53.352759  8403 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.274067  8406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54482 (request call id 227) took 1641 ms. Trace:
W20260709 12:15:53.274760  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 60889.8us
I20260709 12:15:53.276036  8221 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:53.354578  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 78616.4us
I20260709 12:15:53.355453  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:53.356922  8221 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:53.277390  8404 raft_consensus.cc:2393] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:53.278959  8331 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.277592  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.359251  8255 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:53.276551  8330 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.274168  8445 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:53.360390  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 86306.2us
I20260709 12:15:53.271034  8370 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:53.361852  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 106944us
I20260709 12:15:53.300313  8257 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:53.274547  9646 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:53.302425  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.365891  8405 raft_consensus.cc:2410] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:53.306708  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.271746  9687 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.278260  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.274657  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:53.328490  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 99734.5us
I20260709 12:15:53.274914  9548 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:53.270937  9414 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.336333  8327 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:53.330621  9678 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:53.305600  9712 consensus_queue.cc:1059] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:15:53.245545  8369 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:53.373596  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.325119  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.302568  9633 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:53.333722  8402 raft_consensus.cc:2368] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4.
I20260709 12:15:53.338156  9622 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.331203  9681 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.389803  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.329702  9129 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.273327  9701 consensus_queue.cc:1048] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:15:53.277822  9509 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.323201  8328 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:53.272396  9651 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.371605  9699 raft_consensus.cc:2804] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:53.336704  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.363955  8370 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.325848  8253 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:53.355024  9638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.008s
I20260709 12:15:53.372862  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:53.414166  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:53.381812  8155 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37634 (request call id 76) took 12912 ms (client timeout 15000 ms). Trace:
I20260709 12:15:53.414855  8332 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:53.415977  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.416095  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.416592  8332 raft_consensus.cc:3060] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.376173  8220 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:53.276736  8398 rpcz_store.cc:276] 0709 12:15:51.630200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.637197 (+  6997us) service_pool.cc:224] Handling call
0709 12:15:51.679320 (+ 42123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:52.232056 (+552736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:52.232114 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:52.232196 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:52.232255 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.179809 (+947554us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540001bb54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:53.179858 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.179986 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232216832}
I20260709 12:15:53.371441  9683 raft_consensus.cc:2749] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:53.353497  9709 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:53.384500  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 139036us
I20260709 12:15:53.379808  8446 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:53.337733  8153 catalog_manager.cc:5697] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
W20260709 12:15:53.393988  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 143185us
I20260709 12:15:53.438223  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.394948  8443 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:53.407328  8403 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:53.440156  8403 raft_consensus.cc:1240] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:53.374847  9658 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:53.353438  8406 rpcz_store.cc:276] 0709 12:15:51.632408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.740705 (+108297us) service_pool.cc:224] Handling call
0709 12:15:53.273836 (+1533131us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540001d454. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:53.273999 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783419136}
I20260709 12:15:53.383227  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.455556  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.455812  8323 raft_consensus.cc:2376] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4. Re-sending same reply.
I20260709 12:15:53.456324  8477 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.456888  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.457486  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:53.458077  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.376951  9296 raft_consensus.cc:2764] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:15:53.380738  9536 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:53.472676  9536 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.473292  9536 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.475528  9727 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:53.476152  9727 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.476588  9727 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:53.455366  9738 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:15:53.428045  9608 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.480598  9608 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:53.481288  9608 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.482353  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:53.483359  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.484043  8479 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:53.418429  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 54562.9us
I20260709 12:15:53.389623  9610 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:53.486773  9610 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:53.487365  9610 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:53.488673  9740 log.cc:927] Time spent T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:15:53.490182  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 434) took 1859 ms. Trace:
I20260709 12:15:53.385702  9633 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.490595  8399 rpcz_store.cc:276] 0709 12:15:51.631803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.894467 (+262664us) service_pool.cc:224] Handling call
0709 12:15:53.032859 (+1138392us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:53.033071 (+   212us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:53.033458 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.033493 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:53.034148 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 12:15:53.188627 (+154479us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:53.283244 (+ 94617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.302501 (+ 19257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:53.489849 (+187348us) raft_consensus.cc:1685] finished
0709 12:15:53.489876 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.490114 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1289,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":31248768,"thread_start_us":131724,"threads_started":1,"wal-append.queue_time_us":301878}
W20260709 12:15:53.494022  9735 log.cc:927] Time spent T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:15:53.377518  9643 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:53.420823  8330 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:53.496035  9643 raft_consensus.cc:697] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:53.496474  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.382612  9548 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.497272  9643 consensus_queue.cc:237] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.422660  8402 raft_consensus.cc:1275] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:15:53.499137  9742 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:15:53.496531  9624 raft_consensus.cc:3055] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:53.500231  9624 raft_consensus.cc:740] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:53.389961  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.501044  9624 consensus_queue.cc:260] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.386463  8250 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:53.502885  9624 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.382411  8324 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:53.504756  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.506017  8324 raft_consensus.cc:1275] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.288970  8251 rpcz_store.cc:276] 0709 12:15:51.585314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.591566 (+  6252us) service_pool.cc:224] Handling call
0709 12:15:51.592024 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:52.903704 (+1311680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.221746 (+318042us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54005d57d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:53.221956 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2945782016}
I20260709 12:15:53.393540  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.412585  9646 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:15:53.429291  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.429679  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.429992  9651 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.508291  8480 raft_consensus.cc:2368] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:53.508589  8329 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:53.430941  8471 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:53.431119  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:53.431188  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.447443  9658 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.511868  8327 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:53.512125  9658 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.382431  9720 consensus_queue.cc:1048] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:15:53.411789  9699 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:53.513512  9703 consensus_queue.cc:1048] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:53.514149  9699 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:53.411304  9678 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.404757  9642 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
W20260709 12:15:53.448218  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 68512.4us
W20260709 12:15:53.448493  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 53648us
I20260709 12:15:53.428361  9666 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:53.271390  8401 rpcz_store.cc:276] 0709 12:15:51.630837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:51.769135 (+138298us) service_pool.cc:224] Handling call
0709 12:15:51.769572 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:51.769989 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:51.770025 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:51.770630 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:15:51.956665 (+186035us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:51.956734 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:51.956845 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:52.998087 (+1041242us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b48000b73d8. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253016aa1 00007f125300db37 00007f125300d9ca 00007f125310526f 00007f1253104f37 00007f125311955c 00007f1253119508 00007f1253119488 00007f1253119443 00007f12531186ec 00007f1252042a96
0709 12:15:53.183990 (+185903us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:53.186689 (+  2699us) raft_consensus.cc:1685] finished
0709 12:15:53.188299 (+  1610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:53.190855 (+  2556us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2988,"raft.run_cpu_time_us":17606,"raft.run_wall_time_us":1223223,"spinlock_wait_cycles":32226432,"thread_start_us":185540,"threads_started":1,"wal-append.queue_time_us":804493}
I20260709 12:15:53.454866  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.540253  8297 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.462857  8403 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:15:53.541534  8403 pending_rounds.cc:85] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 2
I20260709 12:15:53.541870  8403 pending_rounds.cc:107] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:15:53.542172  8403 raft_consensus.cc:2889] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:53.456166  9741 log.cc:927] Time spent T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:15:53.464927  8332 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.545320  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.377624  9687 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.553745  9687 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:53.429194  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:53.554144  8329 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:53.554569  8472 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.555337  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.556671  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:15:53.415107  8155 rpcz_store.cc:269] 0709 12:15:40.462091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:40.474186 (+ 12095us) service_pool.cc:224] Handling call
0709 12:15:53.374152 (+12899966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:51.292445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:51.293216 (+   771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:51.293268 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:15:51.293306 (+    38us) tablet.cc:662] Decoding operations
0709 12:15:51.294234 (+   928us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:51.294323 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:51.294356 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:15:51.358858 (+ 64502us) tablet.cc:701] Row locks acquired
0709 12:15:51.375522 (+ 16664us) write_op.cc:260] PREPARE: finished
0709 12:15:51.390345 (+ 14823us) write_op.cc:270] Start()
0709 12:15:51.416577 (+ 26232us) write_op.cc:276] Timestamp: P: 1783599351379496 usec, L: 0
0709 12:15:51.416633 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:15:51.417547 (+   914us) log.cc:844] Serialized 2848 byte log entry
0709 12:15:52.859955 (+1442408us) op_driver.cc:464] REPLICATION: finished
0709 12:15:53.131578 (+271623us) write_op.cc:301] APPLY: starting
0709 12:15:53.131690 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:53.131947 (+   257us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:53.132127 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:53.133307 (+  1180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:53.133631 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:15:53.133705 (+    74us) write_op.cc:312] APPLY: finished
0709 12:15:53.134085 (+   380us) log.cc:844] Serialized 58 byte log entry
0709 12:15:53.135066 (+   981us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:53.135205 (+   139us) write_op.cc:454] Released schema lock
0709 12:15:53.135276 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:53.135697 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:53.135731 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":271196,"apply.run_cpu_time_us":3352,"apply.run_wall_time_us":4101,"num_ops":7,"prepare.queue_time_us":213486,"prepare.run_cpu_time_us":16184,"prepare.run_wall_time_us":778869,"raft.queue_time_us":134361,"raft.run_cpu_time_us":38292,"raft.run_wall_time_us":248883,"replication_time_us":1443090,"thread_start_us":801798,"threads_started":4,"wal-append.queue_time_us":1304805}]]}
I20260709 12:15:53.442245  8153 catalog_manager.cc:5697] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 3, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 3 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } }
I20260709 12:15:53.455422  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.561947  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.468262  9661 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:53.458725  8323 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:53.396813  9681 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.499195  9548 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.515514  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.596335  8331 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:53.516371  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 51152.5us
I20260709 12:15:53.600234  8296 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:53.434633  9586 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:53.424571  9638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.002s	sys 0.008s
I20260709 12:15:53.531576  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.521531  8446 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:53.606257  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 84800.2us
I20260709 12:15:53.535703  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.609562  8475 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:53.402174  9129 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.511793  8476 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.461885  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.548014  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.613430  8332 raft_consensus.cc:2376] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6. Re-sending same reply.
I20260709 12:15:53.551384  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.559573  8153 catalog_manager.cc:5697] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 3, leader changed from 35617b9c10ad4daa80878f0de881422c (127.3.34.196) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.563566  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:53.549139  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 196901us
I20260709 12:15:53.572678  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.571354  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.587407  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.546129  8325 raft_consensus.cc:2410] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:53.631918  8399 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:53.632488  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.632866  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.633587  8397 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:53.633772  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.634524  8405 raft_consensus.cc:1240] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:53.547698  9666 raft_consensus.cc:697] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:53.635517  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.635692  9666 consensus_queue.cc:237] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.629917  9586 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:53.537509  9678 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.578691  9683 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:53.616031  8153 catalog_manager.cc:5697] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 4, leader changed from 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194) to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 4 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
I20260709 12:15:53.619107  8298 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:53.611743  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.621491  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:53.611536  9709 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.629511  8472 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:53.622519  9681 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.605759  9727 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.640712  9683 raft_consensus.cc:697] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:53.644172  8471 raft_consensus.cc:2368] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4.
I20260709 12:15:53.615612  9624 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:53.644344  9683 consensus_queue.cc:237] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.644934  9624 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.645306  9624 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.632592  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.633672  9548 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:53.603194  9687 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:53.641062  8324 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.615343  8477 raft_consensus.cc:1240] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:53.641374  8153 catalog_manager.cc:5697] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 3, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.653993  8331 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:53.626720  9699 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.658440  8330 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.538133  9642 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.663316  8473 raft_consensus.cc:2410] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:53.664548  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.665385  9129 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.666074  9509 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:53.666611  9699 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.641438  8401 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:53.667708  8153 catalog_manager.cc:5697] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 3, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.669088  9658 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.670020  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.639345  8476 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:53.672951  8479 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:53.641551  9709 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.642490  9681 raft_consensus.cc:2749] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:53.702070  8153 catalog_manager.cc:5697] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 5, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 5 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.643297  8249 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:53.738667  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.739867  8475 raft_consensus.cc:2393] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:53.737291  8153 catalog_manager.cc:5697] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "35617b9c10ad4daa80878f0de881422c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } }
I20260709 12:15:53.742208  8153 catalog_manager.cc:5697] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 2 to 3, leader changed from b3421ee20b674b879e0633e39c5709d7 (127.3.34.195) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 3 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.752692  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:53.753661  8475 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
W20260709 12:15:53.703522  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 320038us
I20260709 12:15:53.619851  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.708243  9509 consensus_queue.cc:1048] T df3888d0746f41bbbf7b6e82062d3e08 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:53.756839  8153 catalog_manager.cc:5697] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 2, leader changed from <none> to 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193). New cstate: current_term: 2 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } }
W20260709 12:15:53.717873  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:53.724339  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 163945us
W20260709 12:15:53.709642  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 333485us
I20260709 12:15:53.764022  8445 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.765269  8153 catalog_manager.cc:5697] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 0 to 2, leader changed from <none> to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.767313  8153 catalog_manager.cc:5697] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "29d436e9d3d54fe599d9aa67d38fba03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } }
I20260709 12:15:53.762880  8370 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:53.772251  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:53.772519  8153 catalog_manager.cc:5697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 reported cstate change: term changed from 1 to 2, leader changed from 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193) to 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194). New cstate: current_term: 2 leader_uuid: "70ae764f2abd44229023295f5cc6bf37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:53.777096  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 158094us
I20260709 12:15:53.773290  8222 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.771281  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:53.779914  8475 raft_consensus.cc:2376] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3. Re-sending same reply.
I20260709 12:15:53.783594  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.784181  9720 consensus_queue.cc:1048] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:53.785159  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.786304  8475 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 3: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:53.786109  9720 consensus_queue.cc:1048] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:53.756668  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.787863  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.794922  8475 raft_consensus.cc:2393] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 2: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:53.795866  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.796746  8475 raft_consensus.cc:2393] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:53.805382  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:53.808825  8475 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:53.812624  8222 leader_election.cc:400] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Vote denied by peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245) with higher term. Message: Invalid argument: T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4.
W20260709 12:15:53.794018  8254 consensus_meta.cc:287] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
I20260709 12:15:53.789163  9226 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:53.828949  8331 raft_consensus.cc:1275] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:53.830330  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:53.824191  8369 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.833623  8475 raft_consensus.cc:1275] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:53.788726  9759 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:53.769416  9633 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:53.799230  9647 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:53.794036  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:53.834955  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.795782  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:53.844302  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.845870  8331 raft_consensus.cc:2410] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:53.833727  8329 raft_consensus.cc:2410] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:15:53.854054  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 60601.7us
W20260709 12:15:53.851425  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 88603.3us
I20260709 12:15:53.856395  8369 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.821894  9666 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:53.860075  9666 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:53.862205  9666 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:53.833176  9226 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.858495  8220 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:53.862811  9226 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.808080  9748 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:15:53.819523  9548 consensus_queue.cc:1048] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:15:53.837464  9683 consensus_queue.cc:1048] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 12:15:53.833676  8254 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:53.841759  9699 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:53.859671  8370 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.894814  8369 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
    @     0x7f124e4f5980 (unknown) at ??:0
W20260709 12:15:53.991750  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 97068.2us
I20260709 12:15:53.993162  8369 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:53.840893  9647 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:53.980717  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 121120us
I20260709 12:15:53.995503  8369 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:53.855556  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.012316  8370 leader_election.cc:400] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.012836  8370 leader_election.cc:403] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:53.852703  8401 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:53.865389  9509 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 12:15:53.983237  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:53.902704  9771 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:53.985802  9699 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.014789  9771 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:53.936094  9642 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.015095  9699 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:53.963214  8324 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
W20260709 12:15:54.015223  9757 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:15:54.011818  9703 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:53.944788  9756 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 12:15:54.016397  9763 log.cc:927] Time spent T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:15:53.959594  9638 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.017581  9129 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.018108  9129 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:53.853179  9759 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.020295  9129 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:54.021328  9759 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.016433  9703 raft_consensus.cc:697] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.022725  9703 consensus_queue.cc:237] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.002494  9647 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.015285  9771 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.027056  9666 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:54.027478  9666 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.027839  9666 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.036262  9509 raft_consensus.cc:3060] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.036023  9771 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.039196  9771 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.039175  9759 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:54.040632  9773 raft_consensus.cc:3055] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:54.041018  9773 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.041865  9773 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:54.042584  9651 consensus_meta.cc:287] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 12:15:54.042958  9773 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.036088  8370 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.052954  8369 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:53.898583  9765 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:54.085278  8369 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:54.086499  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 188527us
I20260709 12:15:54.091841  8328 raft_consensus.cc:2410] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:15:54.084867  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 226466us
I20260709 12:15:54.056221  9509 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.056597  9678 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.058218  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.059520  9633 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.064934  9666 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.065505  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.066255  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.067507  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.067649  9647 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.070072  9699 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:53.983079  9702 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:54.071754  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.072113  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.100792  9704 raft_consensus.cc:2804] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:54.098245  9771 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:54.073267  8253 consensus_meta.cc:287] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 12:15:54.073343  9658 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:54.074512  9610 consensus_meta.cc:287] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.001s
I20260709 12:15:54.075661  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:53.920702  9750 consensus_queue.cc:1048] T c9125ef7208a4120bf84f3925d5d4521 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:15:53.877359  9226 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.125857  9702 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.109555  8478 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:54.133373  9509 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:15:54.124470  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52799.5us
I20260709 12:15:54.072608  8401 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:54.076678  9624 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.137133  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:54.137842  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 295613us
I20260709 12:15:54.164466  8220 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.167428  8221 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.138782  8403 raft_consensus.cc:1240] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:15:54.138962  8445 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.086189  9765 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:54.126675  9536 consensus_meta.cc:287] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.001s
I20260709 12:15:54.125602  9651 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.153295  8296 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.125293  8476 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:54.152433  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.182547  8478 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:54.138944  9771 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:54.140380  8398 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:54.199285  8220 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.154403  9702 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.142234  8253 raft_consensus.cc:2468] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:54.208017  8220 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:54.192312  9771 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.174026  9765 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.146636  9610 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.198777  9774 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:54.202250  8474 raft_consensus.cc:2393] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:54.202374  9784 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.166313  9548 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:54.203027  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 105300us
I20260709 12:15:54.189785  8296 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.216198  8298 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.219848  8478 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:54.197023  9748 raft_consensus.cc:2749] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:54.147946  9778 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:15:54.203909  9703 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:54.250504  8406 raft_consensus.cc:1240] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:54.179800  9643 consensus_queue.cc:1048] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:15:54.181073  9536 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.153908  9775 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:15:54.223529  8372 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:54.256714  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 67053.4us
I20260709 12:15:54.259600  8296 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.225760  9751 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:54.229427  8369 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.222126  9774 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.233623  9548 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.235168  9651 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.238698  9129 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:54.212672  9704 raft_consensus.cc:697] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.212814  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 195) took 1057 ms. Trace:
I20260709 12:15:54.244108  9608 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.244980  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.247767  8405 raft_consensus.cc:1240] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:54.247628  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.211045  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.212656  9768 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:54.210529  9717 raft_consensus.cc:2764] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 12:15:54.265525  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 229488us
I20260709 12:15:54.266973  8372 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.269698  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.295980  8324 pending_rounds.cc:85] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 0
I20260709 12:15:54.296401  8324 pending_rounds.cc:107] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 12:15:54.296726  8324 raft_consensus.cc:2889] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:54.297699  9727 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.271387  9794 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:54.296173  8329 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:54.299454  9794 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.271435  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.254451  9703 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.221858  9752 consensus_queue.cc:1059] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:15:54.281949  9681 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:54.277696  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 48376.8us
I20260709 12:15:54.310529  8443 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.275938  8257 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.272373  9774 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.288048  9414 consensus_queue.cc:1059] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:54.288757  9608 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.289060  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 187) took 1064 ms. Trace:
I20260709 12:15:54.323148  8330 rpcz_store.cc:276] 0709 12:15:53.224216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.496211 (+271995us) service_pool.cc:224] Handling call
0709 12:15:54.288899 (+792688us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540046c654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:54.289006 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370637056}
I20260709 12:15:54.274798  9790 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:54.291258  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.276674  9683 consensus_queue.cc:1048] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:15:54.255396  9709 consensus_meta.cc:287] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 12:15:54.294036  8370 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.302917  8372 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.296218  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.276177  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.274900  9751 raft_consensus.cc:697] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:54.323504  8296 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.322618  9782 raft_consensus.cc:3055] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:54.307871  9703 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:54.331126  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:54.331425  9787 log.cc:927] Time spent T 9dbab756712a45979451545f2bc323f1 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:15:54.332098  9414 raft_consensus.cc:3055] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:54.274869  9748 raft_consensus.cc:2749] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.335762  8372 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.336251  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:54.339494  8257 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:54.308773  9784 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.306281  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.309144  9759 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:54.310671  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.275100  8253 rpcz_store.cc:276] 0709 12:15:53.155532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.231786 (+ 76254us) service_pool.cc:224] Handling call
0709 12:15:54.210710 (+978924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:54.430491  8298 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:54.487473  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 192859us
W20260709 12:15:54.501237  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 165537us
I20260709 12:15:54.423939  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.344900  8296 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:54.515534  8372 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.500391  8330 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 6.
I20260709 12:15:54.317093  9727 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:54.487824  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 176021us
W20260709 12:15:54.418128  9799 log.cc:927] Time spent T 28270200f56944ca899873c119f8ae9b P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:15:54.334414  9647 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:54.515779  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.530534  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:54.532004  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.328900  9790 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.420439  9792 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:54.334632  9666 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.531010  8445 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.532657  8330 raft_consensus.cc:1275] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:15:54.515493  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 85137.6us
W20260709 12:15:54.523662  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 178812us
I20260709 12:15:54.532053  8479 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
W20260709 12:15:54.426921  9772 log.cc:927] Time spent T d77fccb2892a48378d8e5ae26eba6096 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
I20260709 12:15:54.487996  9705 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.428236  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.447908  9610 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.326081  9681 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.504331  9771 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.538239  9586 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:54.415810  9795 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.326361  9788 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.198s
I20260709 12:15:54.483501  9548 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.501237  9414 raft_consensus.cc:740] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:54.409291  9794 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.421839  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.407886  9226 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:54.420233  9624 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.502403  9782 raft_consensus.cc:740] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:54.525547  9683 raft_consensus.cc:2749] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:54.543255  8220 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:54.562605  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.552021  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.583309  8220 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.519778  9759 raft_consensus.cc:697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.346393  9699 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.536576  9608 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.589931  9608 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.591660  8397 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:54.592617  9608 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.448608  9536 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.565037  8298 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.597018  9752 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:54.597738  9752 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.598217  9752 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.599571  9727 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.599704  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.600582  8255 raft_consensus.cc:2368] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.600291  9727 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.601498  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.602077  8255 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:54.577649  9548 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:54.603518  9548 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.606036  9548 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.607074  9807 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:54.607786  9807 raft_consensus.cc:697] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:54.537774  9790 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.538658  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.608671  8473 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.608798  9807 consensus_queue.cc:237] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.570343  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:54.611701  8402 raft_consensus.cc:2393] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:54.574280  8332 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:54.557564  9705 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.617519  9705 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.618264  9727 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.619057  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.620116  8476 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 5: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:54.621286  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:54.574790  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 43909.7us
I20260709 12:15:54.551467  9792 raft_consensus.cc:697] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.515053  9784 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.562255  8252 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.622606  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.540361  9748 consensus_queue.cc:1059] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:15:54.528436  9642 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:54.411564  9704 consensus_queue.cc:237] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.587811  9414 consensus_queue.cc:260] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.588526  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.588744  9681 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:54.584972  9804 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:54.627964  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 191) took 1504 ms. Trace:
I20260709 12:15:54.626538  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.578517  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.419669  9751 consensus_queue.cc:237] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.650089  8255 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:54.650429  8473 raft_consensus.cc:2468] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:54.623943  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.667780  9792 consensus_queue.cc:237] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.670248  8476 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 7.
I20260709 12:15:54.689697  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.690857  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.691313  9810 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.691591  8329 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:54.691850  9810 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.692535  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.693085  8329 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.694140  9810 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.640034  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:54.696265  8398 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:54.580143  9774 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.697644  9703 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.623023  9586 raft_consensus.cc:697] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.699348  8401 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:54.699448  9414 raft_consensus.cc:3060] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.699712  9586 consensus_queue.cc:237] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.700565  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.701905  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.702508  8253 raft_consensus.cc:2468] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 1.
I20260709 12:15:54.704207  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.682688  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.642529  9642 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.635064  9768 consensus_queue.cc:1048] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:15:54.685756  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.686367  9765 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.656471  9804 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:54.687839  9773 consensus_meta.cc:287] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.002s
I20260709 12:15:54.636217  9536 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:54.709110  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.710594  8369 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.703989  9791 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:54.655567  9651 raft_consensus.cc:3055] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:54.698765  9774 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:54.656519  8256 rpcz_store.cc:276] 0709 12:15:53.123144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.394027 (+270883us) service_pool.cc:224] Handling call
0709 12:15:53.394472 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:53.411378 (+ 16906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.411428 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:53.441492 (+ 30064us) log.cc:844] Serialized 26 byte log entry
0709 12:15:53.758398 (+316906us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:53.781370 (+ 22972us) log.cc:844] Serialized 14 byte log entry
0709 12:15:53.790490 (+  9120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:53.790579 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:54.618297 (+827718us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18001f09c0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afce2a6 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1
0709 12:15:54.619574 (+  1277us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b18001f09c0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124b0003f3 00007f124b0027c1 00007f124b002779 00007f124b002709 00007f124b0026d1 00007f124b0019cd 0000000000388634 0000000000388479 00007f124afe383a
0709 12:15:54.627600 (+  8026us) raft_consensus.cc:1685] finished
0709 12:15:54.627635 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:54.627844 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9175,"prepare.queue_time_us":22749,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2628,"raft.queue_time_us":93511,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":3380,"spinlock_wait_cycles":23556224,"thread_start_us":219974,"threads_started":1,"wal-append.queue_time_us":342035}
I20260709 12:15:54.712543  9642 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.731388  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.732188  8255 raft_consensus.cc:2368] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.733026  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
    @     0x7f12478f3e87 gsignal at ??:0
I20260709 12:15:54.726104  9536 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:54.734171  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.713505  9548 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.723258  9804 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.737689  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.721997  8323 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:54.738956  8255 raft_consensus.cc:2468] T 3344c86d5a404f19a609fac8030806a9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
I20260709 12:15:54.739673  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.740559  8256 raft_consensus.cc:2410] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:54.741341  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.741041  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.742543  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:54.742697  9776 log.cc:927] Time spent T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.539s	user 0.001s	sys 0.000s
I20260709 12:15:54.743330  8256 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:54.744315  8474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 337) took 1187 ms. Trace:
I20260709 12:15:54.744426  8475 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:54.744452  8255 raft_consensus.cc:1275] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:54.728871  9801 raft_consensus.cc:2804] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:15:54.711568  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 85115.9us
I20260709 12:15:54.735445  9536 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:54.746133  8445 leader_election.cc:304] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.714310  9661 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.703552  9296 consensus_queue.cc:1059] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:15:54.789181  9296 raft_consensus.cc:3055] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:54.789525  9296 raft_consensus.cc:740] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:54.790516  8370 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.792387  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.792593  8370 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:54.793892  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:54.717861  9624 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:54.759325  8256 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:54.767073  9727 raft_consensus.cc:2749] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.769917  9788 consensus_queue.cc:1059] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:54.779826  9703 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.779693  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.780923  8257 raft_consensus.cc:1275] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:54.745362  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.744876  8474 rpcz_store.cc:276] 0709 12:15:53.556691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.563278 (+  6587us) service_pool.cc:224] Handling call
0709 12:15:54.744111 (+1180833us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54004713d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:54.744259 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316683008}
I20260709 12:15:54.782070  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.783746  8402 raft_consensus.cc:1275] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:54.785017  8298 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.788074  8372 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:54.794435  8445 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.794528  8331 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:54.780833  8400 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:54.729477  9810 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:54.829623  8296 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:54.830667  8220 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.800019  9707 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.781075  8443 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.855018  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.729743  9651 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:54.758810  9801 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:54.842263  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 54277.3us
I20260709 12:15:54.790325  9296 consensus_queue.cc:260] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.848208  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.855656  8331 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.823393  9773 raft_consensus.cc:2804] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:54.801811  9624 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.739203  9642 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.859941  8257 raft_consensus.cc:1240] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:15:54.856853  8372 leader_election.cc:400] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.869252  8372 leader_election.cc:403] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:15:54.862826  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.871016  8372 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.872212  8372 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.872991  8331 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
W20260709 12:15:54.867547  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 86541.7us
I20260709 12:15:54.824935  9683 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.865058  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.873926  8443 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.873080  8372 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.841015  9748 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:54.704548  9782 consensus_queue.cc:260] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.889830  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:54.745555  9759 consensus_queue.cc:237] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.874660  8329 raft_consensus.cc:2468] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:54.884968  8372 leader_election.cc:400] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.892441  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.893086  8372 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.886561  8443 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.893755  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.881711  9788 raft_consensus.cc:2749] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:54.894378  8474 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:54.800328  9661 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.894793  8443 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:54.896427  9661 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.896929  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:54.897099  9661 raft_consensus.cc:2749] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:54.866132  9624 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:54.897668  9808 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.889282  9608 raft_consensus.cc:2764] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:15:54.889511  9773 raft_consensus.cc:697] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:54.899430  9809 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:54.900171  8401 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:54.899884  9773 consensus_queue.cc:237] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.900846  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:54.902062  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.884995  9771 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.903252  8474 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
I20260709 12:15:54.903604  9771 raft_consensus.cc:2804] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:54.904026  9771 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:54.889830  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:54.904534  9771 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.906008  9766 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:54.886802  9756 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.883069  9814 consensus_queue.cc:1059] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 12:15:54.889346  9683 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.911867  9548 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:54.891122  8480 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:54.899501  9795 raft_consensus.cc:2749] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.746654  9791 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.857215  9801 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.851428  9805 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:54.892992  8329 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:54.863933  9702 consensus_meta.cc:287] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.001s
I20260709 12:15:54.923661  9702 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.924065  9796 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:54.924747  9796 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:54.925916  9702 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:54.925690  9796 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.927834  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.924077  8248 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:54.929457  8478 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:54.898644  9804 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.931437  9804 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.932489  9765 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:54.937453  8252 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:54.938889  8255 raft_consensus.cc:1240] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [1.1-3.2]
I20260709 12:15:54.938748  9651 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.939900  9651 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:54.940536  9771 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.944219  9771 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.944270  8251 raft_consensus.cc:2468] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:54.945624  8329 raft_consensus.cc:2468] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
W20260709 12:15:54.945957  8369 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.194:39513 timed out after 2.000s (SENT) [suppressed 28 similar messages]
I20260709 12:15:54.946753  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:54.948657  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 55679.1us
I20260709 12:15:54.879185  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:54.952550  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:54.953992  8372 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:54.887624  9794 raft_consensus.cc:2749] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731) with higher term. Message: Invalid argument: T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5.
I20260709 12:15:54.918280  8398 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:54.959389  8372 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:54.858117  9810 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:54.915714  9296 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:54.916916  9809 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.910913  9683 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:54.920492  9659 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:54.980176  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.861861  9707 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:54.968837  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:54.959991  9804 raft_consensus.cc:2804] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:54.984027  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:54.906780  9756 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:54.969481  9765 raft_consensus.cc:2749] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:55.006613  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.006271  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.007351  8478 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.973806  9782 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:55.009836  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 180328us
I20260709 12:15:54.979163  9795 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:55.012480  8220 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:55.015714  9414 raft_consensus.cc:2804] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:55.016004  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42044 (request call id 286) took 1358 ms. Trace:
I20260709 12:15:55.016486  9414 raft_consensus.cc:697] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:54.981740  9659 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.974577  8323 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:55.001274  9804 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:54.995790  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:54.978485  9809 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:55.001734  8324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.002s
I20260709 12:15:55.000270  9683 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:55.016624  8475 rpcz_store.cc:276] 0709 12:15:53.657183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.834502 (+177319us) service_pool.cc:224] Handling call
0709 12:15:54.744234 (+909732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:54.745122 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.015686 (+270564us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54004713d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:55.015883 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091498368}
I20260709 12:15:54.916304  9748 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.024282  9659 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:54.964813  9790 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:54.972848  9771 consensus_queue.cc:1059] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:15:55.009253  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.018947  9814 raft_consensus.cc:3055] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:55.051949  9804 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:55.051664  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 105734us
W20260709 12:15:55.045876  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 196939us
I20260709 12:15:55.026042  8399 raft_consensus.cc:1275] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:55.056918  8253 raft_consensus.cc:1275] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:55.017881  9414 consensus_queue.cc:237] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.027292  9795 raft_consensus.cc:697] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
W20260709 12:15:55.053185  8324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.010s	sys 0.003s
I20260709 12:15:55.062964  8478 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:55.051473  8473 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:15:55.071054  9813 log.cc:927] Time spent T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:15:55.071758  9812 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:55.088244  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:55.088495  8323 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:55.078660  9771 consensus_queue.cc:1243] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 29d436e9d3d54fe599d9aa67d38fba03 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:55.054101  9683 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.074574  8443 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:55.095687  8478 raft_consensus.cc:1275] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:15:55.075498  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.079996  9821 consensus_queue.cc:1059] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:15:55.090826  8401 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:55.108000  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.108480  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.109107  8330 raft_consensus.cc:2410] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:15:55.109215  8248 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.110484  8330 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:55.110889  9678 raft_consensus.cc:2804] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:55.111553  9678 raft_consensus.cc:697] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:55.112519  9678 consensus_queue.cc:237] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.113426  9756 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:55.115933  9748 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.115981  9790 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.076488  8297 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.055022  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.073045  9642 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.124670  8475 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
W20260709 12:15:55.082499  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 69908.1us
I20260709 12:15:55.064252  9814 raft_consensus.cc:740] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:55.071197  9624 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:55.134526  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 349558us
I20260709 12:15:55.141645  8298 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:55.141882  8297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 65526.8us
I20260709 12:15:55.134601  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.144459  8297 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.117990  9683 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:55.151587  8298 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.108000  9129 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:55.162283  9824 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.162093  9536 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.133766  9756 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.162798  9824 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.163384  9756 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.165268  9824 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.166100  9756 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.169565  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:55.170678  8298 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.152001  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.159097  9748 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.182928  8298 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.188565  8248 raft_consensus.cc:2468] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 2.
I20260709 12:15:55.189833  8372 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.153146  9823 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:55.168205  9821 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.167140  9791 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:55.180217  9824 raft_consensus.cc:2749] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:55.155681  9643 consensus_queue.cc:1059] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:15:55.195501  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:55.193732  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 119260us
I20260709 12:15:55.180519  9704 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.202069  8248 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.185141  9642 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:55.199183  8298 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.189585  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.195079  9707 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:55.193394  9765 raft_consensus.cc:2804] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.207590  8443 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.207188  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.214249  8478 raft_consensus.cc:3060] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.215094  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.197072  9810 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:55.219604  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.222177  8248 raft_consensus.cc:2468] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:55.227530  8372 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.223260  8478 raft_consensus.cc:2468] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:55.228952  8443 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.205415  9791 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:55.214325  9817 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:15:55.200439  9830 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:15:55.259690  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52137.7us
I20260709 12:15:55.181417  9795 consensus_queue.cc:237] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.226956  8323 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:55.241391  9790 raft_consensus.cc:2804] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:15:55.274145  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 75042.7us
I20260709 12:15:55.208125  9704 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.244396  9765 raft_consensus.cc:697] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.240128  9821 raft_consensus.cc:2749] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.275117  8298 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.269991  8296 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:55.266054  9834 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.287300  8248 raft_consensus.cc:1240] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:55.191463  9814 consensus_queue.cc:260] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:55.281813  9752 consensus_meta.cc:287] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.008s
I20260709 12:15:55.297813  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58516 (request call id 420) took 1027 ms. Trace:
I20260709 12:15:55.308495  8332 rpcz_store.cc:276] 0709 12:15:54.270850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.271073 (+   223us) service_pool.cc:224] Handling call
0709 12:15:55.297638 (+1026565us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54008453d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:55.297747 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628633472}
I20260709 12:15:55.283491  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 429) took 1003 ms. Trace:
I20260709 12:15:55.342950  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.344401  8332 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:15:55.267822  9791 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.346695  8443 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
W20260709 12:15:55.299504  9831 log.cc:927] Time spent T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:15:55.348811  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.303285  9536 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:55.300662  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.350255  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.279966  9790 raft_consensus.cc:697] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.306771  9704 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.342214  9624 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.360857  9683 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:55.363338  9822 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:15:55.373659  8406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 357) took 1920 ms. Trace:
I20260709 12:15:55.346292  9794 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.364766  9834 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:55.295261  9586 consensus_queue.cc:1059] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:15:55.349341  9814 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.367332  9833 raft_consensus.cc:2749] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.345686  9647 consensus_queue.cc:1059] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:15:55.367741  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.369949  9789 raft_consensus.cc:3055] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:55.372255  9791 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:55.404671  9835 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:15:55.405406  9683 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 8 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.374249  8406 rpcz_store.cc:276] 0709 12:15:53.453560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.453706 (+   146us) service_pool.cc:224] Handling call
0709 12:15:53.484908 (+ 31202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:54.254795 (+769887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.370743 (+1115948us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540027c254. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:55.370976 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672388480}
I20260709 12:15:55.407488  9804 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.342485  9752 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.382937  8329 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 8 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:15:55.387012  9647 raft_consensus.cc:3055] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:55.391149  9789 raft_consensus.cc:740] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:55.391237  9586 consensus_queue.cc:1243] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 29d436e9d3d54fe599d9aa67d38fba03 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:55.429587  8250 raft_consensus.cc:2368] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4.
I20260709 12:15:55.383142  8252 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:55.430953  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.431385  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.432035  8252 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.432344  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.437268  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:55.438243  8397 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:55.439510  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:55.391927  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 245) took 1144 ms. Trace:
I20260709 12:15:55.441741  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:55.444145  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.447907  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:55.392185  9750 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.392879  9643 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.393898  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.395192  9642 consensus_queue.cc:1048] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:55.395541  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 120524us
W20260709 12:15:55.395834  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 126146us
I20260709 12:15:55.454687  8296 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:55.396030  9830 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.397192  9823 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:55.398023  9786 log.cc:927] Time spent T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 1.301s	user 0.002s	sys 0.003s
I20260709 12:15:55.423749  9647 raft_consensus.cc:740] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:55.399303  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.400441  9812 raft_consensus.cc:3055] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:55.381726  9834 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.381271  9794 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.345312  8327 rpcz_store.cc:276] 0709 12:15:54.277245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.023628 (+746383us) service_pool.cc:224] Handling call
0709 12:15:55.063930 (+ 40302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.082192 (+ 18262us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:55.142887 (+ 60695us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.236891 (+ 94004us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.261555 (+ 24664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:55.263647 (+  2092us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:55.265179 (+  1532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.274845 (+  9666us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.280400 (+  5555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9643,"prepare.queue_time_us":35409,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2325,"raft.queue_time_us":11112,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":15622,"spinlock_wait_cycles":10418560,"thread_start_us":35993,"threads_started":1,"wal-append.queue_time_us":119832}
I20260709 12:15:55.315415  9659 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.425805  9801 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.426270  9804 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.427003  9752 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:55.427531  9789 consensus_queue.cc:260] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.441011  8475 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:55.442166  8372 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.295521  9765 consensus_queue.cc:237] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.451725  8402 raft_consensus.cc:1240] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:55.460001  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.458739  9129 consensus_queue.cc:1048] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:15:55.465363  8220 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.467871  8298 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:55.457139  9643 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.454605  9750 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.458384  9823 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.473351  8256 raft_consensus.cc:2410] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:55.459201  8324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 422) took 1181 ms. Trace:
I20260709 12:15:55.464196  9705 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:55.482062  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.474165  9683 consensus_queue.cc:1048] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:15:55.468973  9814 raft_consensus.cc:2804] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:15:55.505820  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 63767.9us
I20260709 12:15:55.440297  8397 raft_consensus.cc:2468] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:55.469295  9812 raft_consensus.cc:740] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:55.457520  9809 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:55.511571  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 43790.6us
I20260709 12:15:55.563344  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.564065  8327 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:55.563669  9812 consensus_queue.cc:260] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.564792  9812 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.453341  9756 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:15:55.512184  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 46929us
I20260709 12:15:55.512121  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.446537  8249 rpcz_store.cc:276] 0709 12:15:54.247593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.250052 (+  2459us) service_pool.cc:224] Handling call
0709 12:15:55.367515 (+1117463us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:55.391852 (+ 24337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18511232}
I20260709 12:15:55.477109  9834 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:55.521031  8252 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:55.521875  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.501183  9791 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.453832  9226 consensus_queue.cc:1059] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:15:55.525312  9782 consensus_queue.cc:1059] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:55.473955  9838 consensus_queue.cc:1059] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:15:55.510267  9792 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:55.530426  8477 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:55.598660  9767 raft_consensus.cc:2804] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:55.610637  9767 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.611156  9767 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.523634  9823 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.523427  8324 rpcz_store.cc:276] 0709 12:15:54.275102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.278019 (+  2917us) service_pool.cc:224] Handling call
0709 12:15:54.295723 (+ 17704us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:54.309880 (+ 14157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:54.319929 (+ 10049us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:54.420874 (+100945us) log.cc:844] Serialized 52 byte log entry
0709 12:15:54.914416 (+493542us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124afe30ac 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b
0709 12:15:55.107713 (+193297us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:15:55.107760 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.107842 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:55.437849 (+330007us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54005751a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e062dbe 00007f124e06d930 00007f124e06d8d8 00007f124e06d858 00007f124e06d813 00007f124e06ca9c 00007f1253f582f6 00007f1253f52aa8 00007f124e0a97cb 00007f124e0ac2c0
0709 12:15:55.440430 (+  2581us) raft_consensus.cc:1685] finished
0709 12:15:55.445368 (+  4938us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.455995 (+ 10627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3610,"raft.queue_time_us":8121,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":11839,"spinlock_wait_cycles":65849088,"thread_start_us":661695,"threads_started":1,"wal-append.queue_time_us":653064}
I20260709 12:15:55.614466  9643 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.615526  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.560267  9794 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.529910  9705 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.561038  8326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 203) took 1704 ms. Trace:
I20260709 12:15:55.619421  8326 rpcz_store.cc:276] 0709 12:15:53.856594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.977331 (+120737us) service_pool.cc:224] Handling call
0709 12:15:54.060378 (+ 83047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:54.060947 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:54.060990 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:54.061656 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:15:54.096460 (+ 34804us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:54.096526 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:54.096607 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:55.397359 (+1300752us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:55.511770 (+114411us) raft_consensus.cc:1685] finished
0709 12:15:55.515165 (+  3395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.560962 (+ 45797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1636,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":73,"spinlock_wait_cycles":8493440,"thread_start_us":34324,"threads_started":1,"wal-append.queue_time_us":34836}
I20260709 12:15:55.621516  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.621865  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.622151  8326 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:55.567359  8398 raft_consensus.cc:2393] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:55.623032  8323 raft_consensus.cc:2393] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:55.624146  9705 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:55.624233  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.625324  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:55.625957  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.626905  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.627552  8326 raft_consensus.cc:3060] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.628208  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.630019  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.634291  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:55.616518  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.635344  8324 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.635949  8480 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:15:55.637666  8480 raft_consensus.cc:1275] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:55.567412  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.639279  9792 raft_consensus.cc:697] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.639709  8222 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.640923  9778 raft_consensus.cc:2804] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:55.641407  9778 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:55.640750  9792 consensus_queue.cc:237] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.641774  9778 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.641955  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 246) took 1394 ms. Trace:
I20260709 12:15:55.644068  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:55.644985  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 243) took 1414 ms. Trace:
I20260709 12:15:55.645316  8254 rpcz_store.cc:276] 0709 12:15:54.230304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.231825 (+  1521us) service_pool.cc:224] Handling call
0709 12:15:55.643883 (+1412058us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:55.644918 (+  1035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7432448}
I20260709 12:15:55.568899  8369 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:55.646723  9804 raft_consensus.cc:2804] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:55.647264  9804 raft_consensus.cc:697] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.647362  8476 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:55.647652  9781 raft_consensus.cc:3055] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:55.648207  9804 consensus_queue.cc:237] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.649328  9781 raft_consensus.cc:740] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:55.646759  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 77954.5us
I20260709 12:15:55.650733  9781 consensus_queue.cc:260] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.652194  8369 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:55.652523  9781 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.653882  9759 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:55.654434  9759 raft_consensus.cc:697] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.654681  8403 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54490 (request call id 454) took 1589 ms. Trace:
I20260709 12:15:55.655061  8403 rpcz_store.cc:276] 0709 12:15:54.064783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.066713 (+  1930us) service_pool.cc:224] Handling call
0709 12:15:54.067066 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:54.168292 (+101226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.654406 (+1486114us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b540032a5d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:55.654621 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164092800}
I20260709 12:15:55.656481  9509 raft_consensus.cc:3055] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:55.659546  9759 consensus_queue.cc:237] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.660511  9801 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.661986  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:55.663232  9659 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:55.664723  9783 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 1.571s	user 0.001s	sys 0.006s
I20260709 12:15:55.656944  9509 raft_consensus.cc:740] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:55.466858  9790 consensus_queue.cc:237] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:55.585873  8330 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.514817  9748 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:55.522358  9789 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.586759  8327 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 7.
I20260709 12:15:55.516439  9296 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:55.602739  8404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 358) took 2134 ms. Trace:
I20260709 12:15:55.574028  9814 raft_consensus.cc:697] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:55.675031  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:55.676965  8327 raft_consensus.cc:1240] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:55.573004  9756 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.626794  8323 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:55.668712  8298 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:55.517014  9647 consensus_queue.cc:260] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.671810  9509 consensus_queue.cc:260] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:55.682458  8298 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:55.642366  8250 rpcz_store.cc:276] 0709 12:15:54.247978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.251188 (+  3210us) service_pool.cc:224] Handling call
0709 12:15:55.300474 (+1049286us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:55.641725 (+341251us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54007f8ad4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:55.641891 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188905472}
I20260709 12:15:55.672883  8404 rpcz_store.cc:276] 0709 12:15:53.453894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.483802 (+ 29908us) service_pool.cc:224] Handling call
0709 12:15:53.484161 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:53.484428 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:53.759259 (+274831us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.587879 (+1828620us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b180039cdc0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124dc954bc 00007f124afe348b 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287
0709 12:15:55.588008 (+   129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:55.588082 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:55.588147 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.588242 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.588364 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54107,"prepare.queue_time_us":349061,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":9061,"raft.queue_time_us":27299,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6342,"spinlock_wait_cycles":253696256,"thread_start_us":330857,"threads_started":3,"wal-append.queue_time_us":72152,"wal-append.run_cpu_time_us":1102,"wal-append.run_wall_time_us":1009566}
I20260709 12:15:55.617033  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.674358  9296 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:55.747190  8330 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:55.698482  9756 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:55.718649  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.605890  9791 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:55.714967  9748 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.764017  9782 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:55.730363  9129 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:55.689615  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:55.787125  9814 consensus_queue.cc:237] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:55.758279  9296 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:55.761091  9843 log.cc:927] Time spent T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.375s	user 0.000s	sys 0.002s
I20260709 12:15:55.689842  9643 consensus_queue.cc:1059] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:15:55.750677  9509 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:55.793192  9830 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:55.750092  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:55.805577  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 149185us
I20260709 12:15:55.821754  8369 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:55.805619  8323 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:55.766808  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:55.766283  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 324) took 2175 ms. Trace:
I20260709 12:15:55.752235  8252 raft_consensus.cc:2376] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6. Re-sending same reply.
W20260709 12:15:55.803860  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:55.793609  9782 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.009675  9782 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:55.981626  8330 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 12:15:56.010673  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 335) took 1233 ms. Trace:
I20260709 12:15:56.011055  8330 rpcz_store.cc:276] 0709 12:15:54.776879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.822482 (+1045603us) service_pool.cc:224] Handling call
0709 12:15:55.981374 (+158892us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:56.010379 (+ 29005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.010614 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:55.982230  8327 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:55.983309  8323 raft_consensus.cc:1240] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:55.999276  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 194) took 1481 ms. Trace:
I20260709 12:15:56.001296  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.001456  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.013466  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 432) took 1215 ms. Trace:
I20260709 12:15:55.996095  9765 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:56.003846  9707 consensus_queue.cc:1059] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:56.005005  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 214) took 1313 ms. Trace:
I20260709 12:15:56.024170  8332 rpcz_store.cc:276] 0709 12:15:54.691186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.353759 (+662573us) service_pool.cc:224] Handling call
0709 12:15:55.354145 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:55.424118 (+ 69973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.424167 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:55.446481 (+ 22314us) log.cc:844] Serialized 52 byte log entry
0709 12:15:55.804001 (+357520us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:55.804042 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.804109 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.004788 (+200679us) raft_consensus.cc:1685] finished
0709 12:15:56.004808 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.004951 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57716,"raft.queue_time_us":73029,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":334930,"threads_started":1,"wal-append.queue_time_us":543426}
I20260709 12:15:56.013830  8323 rpcz_store.cc:276] 0709 12:15:54.797861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.914668 (+1116807us) service_pool.cc:224] Handling call
0709 12:15:55.983025 (+ 68357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.013188 (+ 30163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.013410 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:56.000550  8254 raft_consensus.cc:3060] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:56.003146  9767 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.016129  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:56.014467  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.027252  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 435) took 1228 ms. Trace:
I20260709 12:15:56.032807  8249 raft_consensus.cc:2393] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:56.030592  8332 rpcz_store.cc:276] 0709 12:15:54.799047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.026443 (+1227396us) service_pool.cc:224] Handling call
0709 12:15:56.026753 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.026924 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.026949 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.027009 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:56.027040 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.027090 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.027199 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:56.035223  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 437) took 1233 ms. Trace:
I20260709 12:15:56.017601  9765 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.036116  8332 rpcz_store.cc:276] 0709 12:15:54.802315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.034049 (+1231734us) service_pool.cc:224] Handling call
0709 12:15:56.034547 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.034767 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.034804 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.034862 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:56.034904 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.034980 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.035155 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:56.039814  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 438) took 1218 ms. Trace:
I20260709 12:15:56.036019  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:56.042273  8328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 188) took 2814 ms (client timeout 2000 ms). Trace:
I20260709 12:15:56.042331  8332 rpcz_store.cc:276] 0709 12:15:54.821115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.038795 (+1217680us) service_pool.cc:224] Handling call
0709 12:15:56.039179 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.039430 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.039469 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:56.039521 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:56.039563 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.039628 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.039762 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:56.043257  8328 rpcz_store.cc:269] 0709 12:15:53.224518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.428963 (+204445us) service_pool.cc:224] Handling call
0709 12:15:56.038309 (+2609346us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540086a1d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.038472 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330792704}
W20260709 12:15:56.044268  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 267527us
I20260709 12:15:56.046370  8369 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:56.059470  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.060397  8252 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 6.
I20260709 12:15:56.040985  9765 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.041649  8326 raft_consensus.cc:2468] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 4.
I20260709 12:15:56.071045  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.072029  8252 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
W20260709 12:15:56.073822  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 146801us
I20260709 12:15:56.055974  9860 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:56.083184  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.064810  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:56.086386  8369 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:56.090057  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:56.091322  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.095584  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 197) took 1804 ms. Trace:
I20260709 12:15:56.096153  8257 rpcz_store.cc:276] 0709 12:15:54.291006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.874268 (+583262us) service_pool.cc:224] Handling call
0709 12:15:54.874600 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:54.874896 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:54.874913 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:54.887025 (+ 12112us) log.cc:844] Serialized 26 byte log entry
0709 12:15:55.440145 (+553120us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b18002dfe80. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d0d1 00007f124e0a8a0f
0709 12:15:55.691590 (+251445us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:55.691649 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.691743 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:56.085463 (+393720us) raft_consensus.cc:1685] finished
0709 12:15:56.085494 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.095459 (+  9965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8362,"raft.queue_time_us":8183,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2825,"spinlock_wait_cycles":43861376,"thread_start_us":251254,"threads_started":1,"wal-append.queue_time_us":896673}
I20260709 12:15:56.101699  8257 raft_consensus.cc:1240] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
W20260709 12:15:56.111891  9864 log.cc:927] Time spent T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:15:56.019186  8472 rpcz_store.cc:276] 0709 12:15:54.517760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.523964 (+  6204us) service_pool.cc:224] Handling call
0709 12:15:55.607420 (+1083456us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8eee 000000000036eb39 00007f125303c1e0 00007f12531050c4 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:55.607608 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.607844 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:55.608096 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:15:55.821441 (+213345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:55.823041 (+  1600us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:55.856817 (+ 33776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:55.902427 (+ 45610us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.994731 (+ 92304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169,"prepare.queue_time_us":19103,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":17504,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1703,"spinlock_wait_cycles":10065152,"thread_start_us":185654,"threads_started":1,"wal-append.queue_time_us":432684}
W20260709 12:15:56.119498  9859 log.cc:927] Time spent T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:15:56.121902  8326 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.123342  9753 raft_consensus.cc:2804] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:56.124163  9753 raft_consensus.cc:697] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.124943  8257 raft_consensus.cc:1275] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:56.125339  9753 consensus_queue.cc:237] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:56.128394  9819 log.cc:927] Time spent T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 1.078s	user 0.002s	sys 0.000s
W20260709 12:15:56.130322  9862 log.cc:927] Time spent T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:15:56.132681  9863 log.cc:927] Time spent T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:15:56.134703  9812 consensus_meta.cc:287] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.003s
    @     0x7f12478f57f1 abort at ??:0
    @           0x2da276 abort at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
W20260709 12:15:56.142808  9778 consensus_meta.cc:287] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
I20260709 12:15:56.144351  8326 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:55.839609  8325 rpcz_store.cc:276] 0709 12:15:53.582500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.634777 (+ 52277us) service_pool.cc:224] Handling call
0709 12:15:53.679922 (+ 45145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:53.752376 (+ 72454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:53.754694 (+  2318us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:53.834642 (+ 79948us) log.cc:844] Serialized 26 byte log entry
0709 12:15:54.093698 (+259056us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:54.221832 (+128134us) log.cc:844] Serialized 14 byte log entry
0709 12:15:54.244410 (+ 22578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:54.244496 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:55.664061 (+1419565us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:55.673848 (+  9787us) raft_consensus.cc:1685] finished
0709 12:15:55.728466 (+ 54618us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:55.751547 (+ 23081us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18347,"prepare.queue_time_us":169839,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3353,"raft.queue_time_us":15791,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":5535,"spinlock_wait_cycles":90562816,"thread_start_us":309258,"threads_started":2,"wal-append.queue_time_us":241129}
I20260709 12:15:56.151937  8328 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.154145  8252 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:56.078927  9801 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
W20260709 12:15:56.164271  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:56.169474  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 83197.8us
I20260709 12:15:56.094709  9860 raft_consensus.cc:697] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
W20260709 12:15:56.159662  9820 log.cc:927] Time spent T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:15:56.169620  8252 raft_consensus.cc:3055] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:56.151347  9791 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:56.176477  8252 raft_consensus.cc:740] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:56.195917  8328 raft_consensus.cc:1275] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:56.203265  9727 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:56.163942  9226 consensus_queue.cc:1059] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:15:56.214331  9226 raft_consensus.cc:3055] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:56.165200  9801 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.162312  9778 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.218461  8252 consensus_queue.cc:260] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.227629  8252 raft_consensus.cc:3060] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:56.216157  9789 consensus_meta.cc:287] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.544s	user 0.015s	sys 0.009s
I20260709 12:15:56.209707  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.250603  9296 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.220651  9226 raft_consensus.cc:740] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:56.256372  8472 raft_consensus.cc:1275] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.257678  9860 consensus_queue.cc:237] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:56.263600  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 107235us
I20260709 12:15:56.268257  8257 raft_consensus.cc:1240] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.267589  8325 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 2.
I20260709 12:15:56.270692  9226 consensus_queue.cc:260] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.271531  8325 raft_consensus.cc:1275] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:56.271730  9296 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:56.272022  9226 raft_consensus.cc:3060] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:56.277632  8443 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.231050  8328 raft_consensus.cc:1240] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:56.283107  8252 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:15:56.228091  9823 consensus_meta.cc:287] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.001s
I20260709 12:15:56.283484  9789 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:15:56.290316  9414 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:15:56.295876  9789 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.298225  9875 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.293834  9823 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:56.308245  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 77557us
I20260709 12:15:56.307507  8328 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 12:15:56.306912  9789 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:56.315119  9869 log.cc:927] Time spent T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:15:56.315721  9778 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.302775  8325 raft_consensus.cc:1275] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:56.318019  8254 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:56.319046  8249 raft_consensus.cc:1240] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:15:56.319161  9823 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:56.320118  8332 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:56.326066  9765 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.327507  8398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54482 (request call id 249) took 1251 ms. Trace:
I20260709 12:15:56.328263  8398 rpcz_store.cc:276] 0709 12:15:55.075794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.078394 (+  2600us) service_pool.cc:224] Handling call
0709 12:15:56.327218 (+1248824us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54001e2b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.327414 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099429248}
W20260709 12:15:56.330802  9834 consensus_meta.cc:287] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 12:15:56.330763  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.340374  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.343775  8476 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:56.347853  9867 log.cc:927] Time spent T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:15:56.349059  9834 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.351465  9834 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:56.310786  9875 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.352216  8476 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:56.353840  9875 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:56.354278  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 308) took 1148 ms. Trace:
I20260709 12:15:56.354498  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.354699  8475 rpcz_store.cc:276] 0709 12:15:55.206312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.219314 (+ 13002us) service_pool.cc:224] Handling call
0709 12:15:56.354107 (+1134793us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400344c54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.354223 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493377280}
I20260709 12:15:56.355459  8296 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.356433  8446 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.356439  9642 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:56.357311  9642 raft_consensus.cc:697] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
W20260709 12:15:56.339499  9781 consensus_meta.cc:287] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.686s	user 0.015s	sys 0.000s
I20260709 12:15:56.357815  8446 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:56.358253  9781 raft_consensus.cc:2749] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:56.358927  9781 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:56.358258  9642 consensus_queue.cc:237] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:56.360616  8324 consensus_meta.cc:287] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.000s
I20260709 12:15:56.361032  8324 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:56.361806  8330 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:15:56.362353  9750 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.363173  8478 raft_consensus.cc:1275] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:56.363400  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.364042  8330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 433) took 1565 ms. Trace:
I20260709 12:15:56.364610  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 213) took 1126 ms. Trace:
I20260709 12:15:56.364423  8330 rpcz_store.cc:276] 0709 12:15:54.798202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.011910 (+1213708us) service_pool.cc:224] Handling call
0709 12:15:56.361552 (+349642us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:56.362241 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.363845 (+  1604us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540032d050. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.363977 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803045760}
I20260709 12:15:56.365114  8478 rpcz_store.cc:276] 0709 12:15:55.238045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.238217 (+   172us) service_pool.cc:224] Handling call
0709 12:15:56.362823 (+1124606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.363798 (+   975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.364417 (+   619us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400344c50. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.364551 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585531136}
I20260709 12:15:56.368683  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:56.370404  8446 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.372236  8446 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.380336  8446 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.386354  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:56.377461  9756 consensus_meta.cc:287] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
I20260709 12:15:56.379179  9834 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:15:56.393211  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.386744  9875 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:56.393710  9834 raft_consensus.cc:697] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:56.394747  9834 consensus_queue.cc:237] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.396214  8480 raft_consensus.cc:2468] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:56.385900  9781 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:56.378599  9823 raft_consensus.cc:2804] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:56.392762  8446 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.400014  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:56.392760  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.401495  9705 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:56.386539  9794 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:56.404444  9823 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.410349  9823 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:56.412215  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.413518  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.415253  8250 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:56.415617  9794 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.415306  9765 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.418658  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.417717  9226 consensus_queue.cc:1059] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:15:56.408842  9705 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:56.423115  9705 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.423265  9771 raft_consensus.cc:3055] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:56.423780  9771 raft_consensus.cc:740] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.424733  9771 consensus_queue.cc:260] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.425787  9771 raft_consensus.cc:3060] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:56.414940  8254 raft_consensus.cc:1240] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:56.432916  9789 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.408900  9875 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:56.435956  9794 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:56.399327  9756 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.436582  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.437527  8331 raft_consensus.cc:2410] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:56.437549  9870 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:56.438113  8331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58520 (request call id 334) took 1661 ms (client timeout 2144 ms). Trace:
I20260709 12:15:56.438412  9870 consensus_queue.cc:1243] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 70ae764f2abd44229023295f5cc6bf37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:56.439370  8248 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 6: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
W20260709 12:15:56.438549  8331 rpcz_store.cc:269] 0709 12:15:54.776641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.874661 (+ 98020us) service_pool.cc:224] Handling call
0709 12:15:56.436425 (+1561764us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:56.438034 (+  1609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9984384}
I20260709 12:15:56.437681  8369 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:56.442058  8331 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:56.443126  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.444518  9860 consensus_queue.cc:1048] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.417284  9781 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:56.449781  9879 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:15:56.452626  9651 raft_consensus.cc:3055] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:56.453182  9651 raft_consensus.cc:740] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:56.453553  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.454257  8330 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.456442  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:56.456976  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 2.249e+06us
I20260709 12:15:56.457813  8221 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:56.459556  8221 leader_election.cc:400] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4.
I20260709 12:15:56.459869  8221 leader_election.cc:403] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:56.456631  9706 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:56.461802  9706 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.462714  8324 raft_consensus.cc:1275] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.460834  9705 raft_consensus.cc:515] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.464291  9706 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:56.466928  9790 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:56.468051  9790 raft_consensus.cc:697] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.467255  9651 consensus_queue.cc:260] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.468991  9790 consensus_queue.cc:237] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.469812  9756 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.465471  9705 leader_election.cc:290] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:56.465627  9296 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:56.466666  8251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 205) took 2168 ms (client timeout 1682 ms). Trace:
I20260709 12:15:56.474171  9791 consensus_queue.cc:1048] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:56.436619  9794 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:15:56.469132  9651 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:56.480732  8330 raft_consensus.cc:2468] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
I20260709 12:15:56.486289  8221 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:56.486599  8251 rpcz_store.cc:269] 0709 12:15:54.297883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.689390 (+391507us) service_pool.cc:224] Handling call
0709 12:15:56.466431 (+1777041us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400517054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.466570 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565727616}
I20260709 12:15:56.485603  9706 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:56.496496  8221 connection.cc:256] RPC call timeout handler was delayed by -1.6392313060000561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:15:56.497234  8478 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:56.487392  9756 raft_consensus.cc:2749] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085) with higher term. Message: Invalid argument: T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4.
I20260709 12:15:56.495687  9789 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
    @     0x7f124a6c5d84 google::LogMessage::SendToLog() at ??:0
I20260709 12:15:56.504132  9647 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:56.488333  9750 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:56.508492  9848 log.cc:927] Time spent T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.940s	user 0.002s	sys 0.000s
I20260709 12:15:56.509352  9823 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.509984  9414 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:56.510269  9782 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:56.511643  9876 log.cc:927] Time spent T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:15:56.513823  9706 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.515682  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54482 (request call id 246) took 1716 ms. Trace:
I20260709 12:15:56.515899  8475 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:56.488739  9781 consensus_queue.cc:1059] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:15:56.519214  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.521945  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 440) took 1500 ms. Trace:
I20260709 12:15:56.536885  8332 rpcz_store.cc:276] 0709 12:15:55.021190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.043576 (+1022386us) service_pool.cc:224] Handling call
0709 12:15:56.043965 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.320580 (+276615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.521561 (+200981us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400081954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.521853 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634473216}
I20260709 12:15:56.538759  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.523108  9784 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.524672  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 310) took 1136 ms. Trace:
I20260709 12:15:56.529606  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.529663  8446 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.526775  9801 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:56.516053  8473 raft_consensus.cc:1240] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:56.528648  9681 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:56.494949  9705 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:15:56.541071  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.542411  8255 rpcz_store.cc:276] 0709 12:15:55.388645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.394586 (+  5941us) service_pool.cc:224] Handling call
0709 12:15:55.395011 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.567833 (+172822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:55.567869 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:55.567917 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:55.567951 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.524296 (+956345us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540053cfd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.524395 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:56.524591 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396913024}
I20260709 12:15:56.542754  8330 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.559299  8332 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:56.531481  9414 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.548074  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.551826  8446 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:15:56.561426  8297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.532315  9782 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.566725  8330 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:56.569031  8475 raft_consensus.cc:2393] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:56.557077  9789 raft_consensus.cc:2804] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:56.570565  8443 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.556627  9784 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.573133  8332 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:56.574131  8330 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:56.575791  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.578244  9706 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:56.579546  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.563612  9834 consensus_queue.cc:1048] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:56.560776  9681 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.582300  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 329) took 1807 ms. Trace:
I20260709 12:15:56.583021  9681 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:56.582742  8327 rpcz_store.cc:276] 0709 12:15:54.775270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.678009 (+902739us) service_pool.cc:224] Handling call
0709 12:15:55.828921 (+150912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.012781 (+183860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.582057 (+569276us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002265d0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.582232 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346070272}
I20260709 12:15:56.584321  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.585182  8474 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:56.585465  8478 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.587376  9767 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.587669  9782 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.569530  8324 raft_consensus.cc:1240] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:15:56.533103  8399 rpcz_store.cc:276] 0709 12:15:54.798808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.903661 (+104853us) service_pool.cc:224] Handling call
0709 12:15:54.903997 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.079886 (+175889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.515385 (+1435499us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540027d654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.515611 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161831680}
I20260709 12:15:56.589418  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 309) took 1201 ms. Trace:
I20260709 12:15:56.589859  8248 rpcz_store.cc:276] 0709 12:15:55.388304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.393482 (+  5178us) service_pool.cc:224] Handling call
0709 12:15:56.589197 (+1195715us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400577bd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.589359 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2271871872}
I20260709 12:15:56.593241  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.595121  9414 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:56.596879  8371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.597368  9681 consensus_queue.cc:1048] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:56.599978  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.601121  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.601209  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.602077  8480 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:56.602272  9804 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:56.602511  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.604187  8369 leader_election.cc:304] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:56.605211  9795 raft_consensus.cc:2804] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:56.605708  9795 raft_consensus.cc:697] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 6 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.606550  9795 consensus_queue.cc:237] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.607131  9784 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.609350  9784 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:56.601261  9771 consensus_queue.cc:1048] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:15:56.611208  9771 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:56.611542  9809 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.611996  9771 raft_consensus.cc:3055] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:56.614792  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:56.617302  8480 raft_consensus.cc:1275] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.617421  8475 raft_consensus.cc:2468] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 7.
I20260709 12:15:56.620157  8323 raft_consensus.cc:1275] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:56.614384  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.622614  8400 raft_consensus.cc:1275] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:56.623690  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.624481  8406 raft_consensus.cc:2393] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:56.612365  9771 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.631773  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:56.634137  8370 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:56.637569  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.640610  8370 leader_election.cc:304] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.643908  9701 raft_consensus.cc:3055] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:56.644434  9701 raft_consensus.cc:740] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:56.645364  9701 consensus_queue.cc:260] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.646672  9701 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:56.638348  8221 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:56.648244  9756 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.655174  9801 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:56.655844  9801 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [term 6 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.656771  9801 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.655875  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 200) took 2364 ms. Trace:
I20260709 12:15:56.639542  9414 consensus_queue.cc:1059] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:15:56.659678  8253 rpcz_store.cc:276] 0709 12:15:54.291800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.893698 (+601898us) service_pool.cc:224] Handling call
0709 12:15:54.893994 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:55.080550 (+186556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.655598 (+1575048us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540048a8d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.655806 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297385216}
I20260709 12:15:56.660470  9414 raft_consensus.cc:3055] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:56.660838  9414 raft_consensus.cc:740] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:56.661754  9414 consensus_queue.cc:260] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:56.619639  9823 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.670053  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:56.668488  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:56.671061  8480 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 6.
I20260709 12:15:56.672963  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:56.674873  8399 raft_consensus.cc:3060] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.675643  9756 raft_consensus.cc:2749] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:56.676656  9751 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:56.672510  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.680127  8479 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:56.683508  8398 raft_consensus.cc:1240] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.683545  8399 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:56.684675  8480 raft_consensus.cc:1275] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:56.686323  9790 consensus_queue.cc:1048] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:56.678488  9887 log.cc:927] Time spent T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:15:56.682621  9704 raft_consensus.cc:2804] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:56.690897  9704 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:56.691308  9704 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.693498  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:56.694211  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.694931  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.664743  9414 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:56.694105  9784 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.696452  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:56.696767  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
W20260709 12:15:56.697070  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.695828  8400 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 2.
I20260709 12:15:56.698769  8472 raft_consensus.cc:2393] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:15:56.699674  8398 raft_consensus.cc:2393] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:56.697535  8479 raft_consensus.cc:2468] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 8.
I20260709 12:15:56.686774  8370 leader_election.cc:304] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.697499  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:56.700615  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.703330  8472 raft_consensus.cc:1240] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:56.705298  9875 raft_consensus.cc:3055] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:56.705772  9875 raft_consensus.cc:740] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:56.706676  9875 consensus_queue.cc:260] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:56.707890  9875 raft_consensus.cc:3060] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:56.705511  8477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 335) took 3149 ms (client timeout 1886 ms). Trace:
I20260709 12:15:56.716621  8403 raft_consensus.cc:1240] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.717432  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 436) took 1918 ms. Trace:
I20260709 12:15:56.717840  8323 rpcz_store.cc:276] 0709 12:15:54.799354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.027932 (+1228578us) service_pool.cc:224] Handling call
0709 12:15:56.029179 (+  1247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.620595 (+591416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.717204 (+ 96609us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540047d1d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.717373 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342121216}
I20260709 12:15:56.719228  8406 raft_consensus.cc:1240] T fd5832a7f1874b879d2943248a7135fe P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:15:56.723634  8472 raft_consensus.cc:1275] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:56.725778  9646 raft_consensus.cc:3055] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:56.726243  9646 raft_consensus.cc:740] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:56.727144  9646 consensus_queue.cc:260] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:56.728385  9646 raft_consensus.cc:3060] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:56.700340  9784 raft_consensus.cc:515] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:56.731158  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 160728us
I20260709 12:15:56.731992  9784 leader_election.cc:290] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:56.732887  9651 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.733780  9651 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:56.734431  9888 log.cc:927] Time spent T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 12:15:56.735491  8324 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:56.736605  9706 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:56.739813  8370 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:56.738581  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.749421  8323 raft_consensus.cc:2410] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:56.750742  8370 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.756234  8472 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:56.758124  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 328) took 1243 ms. Trace:
I20260709 12:15:56.758738  8257 rpcz_store.cc:276] 0709 12:15:55.514541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.125989 (+611448us) service_pool.cc:224] Handling call
0709 12:15:56.126309 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:56.269742 (+143433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.757808 (+488066us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400515754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:56.758047 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325781248}
I20260709 12:15:56.767107  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:56.768877  8323 raft_consensus.cc:1240] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.769867  8298 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:56.772574  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:56.715656  8477 rpcz_store.cc:269] 0709 12:15:53.556136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:53.748332 (+192196us) service_pool.cc:224] Handling call
0709 12:15:55.132241 (+1383909us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:56.705167 (+1572926us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400184054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.705384 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770960128}
I20260709 12:15:56.722329  9792 raft_consensus.cc:2749] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:56.737129  9226 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:15:56.752453  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.753726  8471 raft_consensus.cc:3055] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:56.740676  9784 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.785416  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.788859  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.789265  8476 raft_consensus.cc:1275] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:56.752159  9794 raft_consensus.cc:2749] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:56.789948  8220 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:56.810506  8372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.859516  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:56.697523  9771 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:56.757072  9795 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.861841  8326 raft_consensus.cc:2410] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 12:15:56.861701  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 182315us
I20260709 12:15:56.865339  8398 raft_consensus.cc:1240] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.866534  8257 raft_consensus.cc:1240] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:15:56.751919  9889 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:56.761000  9773 raft_consensus.cc:2804] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:56.754400  9681 consensus_queue.cc:1048] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:15:56.873661  8404 raft_consensus.cc:1240] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [term 2 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:56.761183  9833 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:56.751293  9790 consensus_queue.cc:1048] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.107s
W20260709 12:15:56.942073  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 366804us
I20260709 12:15:56.753813  9759 consensus_queue.cc:1048] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 12:15:56.835583  9748 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:56.954463  8220 leader_election.cc:304] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.790400  8471 raft_consensus.cc:740] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:56.963778  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.873369  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:56.871713  9839 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:56.981323  8220 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.981995  8255 raft_consensus.cc:1275] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:56.873152  8400 raft_consensus.cc:1240] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:56.867933  9706 raft_consensus.cc:697] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:56.986284  8445 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.986554  8443 leader_election.cc:304] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:56.981398  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.005384  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 428) took 2728 ms. Trace:
W20260709 12:15:56.995863  8256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34266 (request call id 212) took 2194 ms (client timeout 1965 ms). Trace:
I20260709 12:15:57.005959  8329 rpcz_store.cc:276] 0709 12:15:54.276976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.013153 (+736177us) service_pool.cc:224] Handling call
0709 12:15:55.013549 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:55.417587 (+404038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.005108 (+1587521us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54004d3354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:57.005327 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848948608}
W20260709 12:15:57.006479  8256 rpcz_store.cc:269] 0709 12:15:54.786175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:54.848483 (+ 62308us) service_pool.cc:224] Handling call
0709 12:15:56.957410 (+2108927us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54005d57d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:56.980482 (+ 23072us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386883968}
I20260709 12:15:56.875933  9651 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:56.931253  9751 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:56.937341  9782 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:56.834931  9860 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:15:56.860714  9784 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.009953  8404 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:56.977280  9748 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:56.997681  9771 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:56.981894  9773 raft_consensus.cc:697] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:56.998185  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830be490ae644f67b4bf87248e3bb615" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:56.998376  9752 raft_consensus.cc:2804] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:15:57.042721  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 56279.4us
I20260709 12:15:57.027779  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:57.024920  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:57.012014  9789 raft_consensus.cc:697] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [term 4 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:57.036167  8250 raft_consensus.cc:1240] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:15:57.036332  9748 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:57.041733  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.046324  8443 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:56.958617  9833 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.011721  9814 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:57.038170  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.023170  9651 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.051192  8248 raft_consensus.cc:1275] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.952742  9889 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:57.052489  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:56.946193  9795 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.028898  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.062813  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.061590  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.029156  9705 consensus_queue.cc:1059] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:15:57.068727  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3344c86d5a404f19a609fac8030806a9" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:57.051139  9727 raft_consensus.cc:2749] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:57.024255  9704 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.023520  9751 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.028529  9782 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.056620  9756 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:57.087901  8475 raft_consensus.cc:1275] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:57.003706  9839 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.096043  9706 consensus_queue.cc:237] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.098254  9839 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
W20260709 12:15:56.953207  9586 consensus_queue.cc:1175] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35617b9c10ad4daa80878f0de881422c" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:57.054790  9897 raft_consensus.cc:2804] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:57.062781  9651 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:57.082526  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:57.093278  9894 log.cc:927] Time spent T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:15:57.093957  9892 log.cc:927] Time spent T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:15:57.095001  9784 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:57.095633  9795 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:57.095837  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.051375  9661 consensus_queue.cc:1059] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:15:57.100622  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedb2c9a19ab4ffbac05001cfcb9bf84" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:57.061551  8254 raft_consensus.cc:1275] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:57.074115  8253 raft_consensus.cc:2393] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:57.055599  9814 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.112735  8255 raft_consensus.cc:2468] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:57.113032  8445 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:57.108371  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 127115us
I20260709 12:15:57.120039  8399 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [term 6 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:57.124467  8446 leader_election.cc:304] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:57.042124  8471 consensus_queue.cc:260] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.135859  8326 raft_consensus.cc:1275] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:15:57.136447  8326 pending_rounds.cc:85] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 1
I20260709 12:15:57.136755  8326 pending_rounds.cc:107] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:15:57.136621  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.137298  8326 raft_consensus.cc:2889] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:57.075313  8477 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:57.107656  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:57.110180  9756 raft_consensus.cc:697] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:57.144446  9900 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:57.144621  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.145757  9902 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.148751  8253 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:57.149631  9651 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:57.151078  8471 raft_consensus.cc:3060] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:57.152113  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:57.152645  9701 consensus_meta.cc:287] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.006s
I20260709 12:15:57.153133  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.154209  8250 raft_consensus.cc:1275] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:57.115299  9752 raft_consensus.cc:697] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
W20260709 12:15:57.156932  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:57.162583  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 49649.6us
I20260709 12:15:57.170675  8257 raft_consensus.cc:2468] T 028c831fc6fe4bc3a5dacb16c136884b P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 3.
I20260709 12:15:57.182183  8257 raft_consensus.cc:1240] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:15:57.173648  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.140367  9784 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:57.174787  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 78467.5us
I20260709 12:15:57.175879  8255 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:57.183708  8446 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:57.103305  9773 consensus_queue.cc:237] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.211634  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.206369  8296 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:57.204954  9784 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.228458  9651 raft_consensus.cc:2804] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:15:57.229151  9901 log.cc:927] Time spent T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:15:57.229892  9907 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.230567  9907 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.234967  9907 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.229111  9651 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.236168  9651 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:15:57.238184  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.244153  9790 consensus_queue.cc:1059] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:57.245016  9790 consensus_queue.cc:1243] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 70ae764f2abd44229023295f5cc6bf37 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:15:57.246784  9767 raft_consensus.cc:3055] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:57.164746  9823 consensus_queue.cc:1048] T ae4f4f07bd32437a98ac789ece17a21b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:15:57.111599  9789 consensus_queue.cc:237] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.180115  9885 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:57.167343  9781 consensus_queue.cc:1048] T d72e932c2eee4dd28f7f05aa582fcfb0 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:15:57.188328  9794 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:57.264222  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 140796us
I20260709 12:15:57.247241  9767 raft_consensus.cc:740] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:57.307004  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.169852  9902 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.167968  9900 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.259366  8249 raft_consensus.cc:1275] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:57.320142  8405 raft_consensus.cc:1275] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:15:57.320698  8405 pending_rounds.cc:85] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Aborting all ops after (but not including) 1
I20260709 12:15:57.321039  8405 pending_rounds.cc:107] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:15:57.321353  8405 raft_consensus.cc:2889] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:57.258128  9915 raft_consensus.cc:2804] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:15:57.323750  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 142941us
I20260709 12:15:57.262403  9727 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.329830  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.331614  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1928b0c529924067acf1990936762a6e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
W20260709 12:15:57.332863  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 149226us
I20260709 12:15:57.310971  9659 raft_consensus.cc:2804] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:57.336647  8445 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03
W20260709 12:15:57.334432  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 91238.3us
I20260709 12:15:57.309381  8324 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:15:57.303067  9794 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.343784  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.311383  9897 raft_consensus.cc:697] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:57.329789  8254 raft_consensus.cc:1275] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:57.325793  9701 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:57.351720  8371 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.326467  9706 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.332386  9833 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.355932  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.259835  9756 consensus_queue.cc:237] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.362792  8326 raft_consensus.cc:1275] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:15:57.365178  8323 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:57.348240  8324 pending_rounds.cc:85] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 2
I20260709 12:15:57.338433  9915 raft_consensus.cc:697] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:57.374573  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:57.346042  9704 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:57.369618  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.370257  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.340015  9659 raft_consensus.cc:493] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
W20260709 12:15:57.374855  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 108136us
I20260709 12:15:57.345692  9804 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.369073  8327 raft_consensus.cc:1275] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:57.334064  9727 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.371737  8324 pending_rounds.cc:107] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:15:57.396209  8327 raft_consensus.cc:1275] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:57.397053  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.398240  8332 raft_consensus.cc:2410] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 5 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 12:15:57.386502  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 48175.6us
I20260709 12:15:57.366545  9782 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.392445  8397 raft_consensus.cc:1275] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:57.392834  9928 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.375937  9833 raft_consensus.cc:2804] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:57.365527  9701 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.415380  8372 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:57.415741  8445 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:57.329423  9752 consensus_queue.cc:237] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.430660  9794 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:57.431069  9927 consensus_queue.cc:1059] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:57.432478  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.433418  8406 raft_consensus.cc:2410] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:15:57.378639  9889 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.360136  9905 consensus_queue.cc:1048] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:15:57.424392  8372 leader_election.cc:304] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:57.376205  9778 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:15:57.428933  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.431416  9794 raft_consensus.cc:2749] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:57.390050  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.384721  9659 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:57.394246  9814 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.439657  8372 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:57.425635  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.460299  8372 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:57.412485  8324 raft_consensus.cc:2889] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:57.370643  9706 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.351060  9767 consensus_queue.cc:260] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.453994  9911 consensus_queue.cc:1048] T 23b9669b9bee44ffa43fecf53ed6ca9f P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:15:57.467078  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.440661  9833 raft_consensus.cc:697] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:57.440685  9727 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.435642  9919 consensus_queue.cc:1059] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:15:57.412103  9804 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.452611  9792 raft_consensus.cc:2749] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:57.433951  9704 consensus_queue.cc:1048] T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:57.448087  9782 consensus_queue.cc:1059] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 12:15:57.498848  9646 consensus_meta.cc:287] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.770s	user 0.013s	sys 0.000s
I20260709 12:15:57.499459  8249 raft_consensus.cc:1240] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:15:57.552712  9875 consensus_meta.cc:287] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.844s	user 0.013s	sys 0.001s
I20260709 12:15:57.553196  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:57.502650  9809 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:57.553817  9706 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.554387  8249 raft_consensus.cc:2410] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:57.533823  9651 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:57.538414  9701 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:57.556210  9900 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:57.539414  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.557367  8404 raft_consensus.cc:2393] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:57.557590  9651 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:57.501884  9910 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:57.541791  9414 consensus_meta.cc:287] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.004s
I20260709 12:15:57.544059  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.546226  9833 consensus_queue.cc:237] T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:57.547626  9914 log.cc:927] Time spent T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:15:57.512116  9915 consensus_queue.cc:237] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.547926  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.524696  9902 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:57.549566  9586 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.562088  8329 raft_consensus.cc:1240] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:57.539729  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.436421  9928 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:57.502619  9794 consensus_queue.cc:1048] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 12:15:57.591437  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:57.445655  9897 consensus_queue.cc:237] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.600742  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af028603c5e74d4c8e598da3c03999d8" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.511296  9921 consensus_queue.cc:1048] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 12:15:57.565174  9767 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:57.610349  8221 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:57.611057  9701 consensus_queue.cc:1048] T 6aec989e68ad45a3b8540a35920b4b4e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:15:57.600433  9814 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.604403  9586 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.589546  9651 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.622269  8221 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:57.591570  9900 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.592612  8254 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:57.599793  9909 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.609163  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.645365  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.655403  8473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 353) took 1136 ms. Trace:
I20260709 12:15:57.627910  9930 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:57.646064  9646 consensus_queue.cc:1048] T e17a45545cc34a9ca0576c94ee626ccc P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:15:57.641409  9918 raft_consensus.cc:2749] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:57.657923  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.659157  9586 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:57.665452  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 205216us
W20260709 12:15:57.669302  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:57.661936  9659 raft_consensus.cc:515] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:57.644052  9771 consensus_meta.cc:287] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.000s
W20260709 12:15:57.665134  9929 log.cc:927] Time spent T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:15:57.730839  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.695636  8478 raft_consensus.cc:2393] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:57.673496  9911 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.732918  9870 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:57.784714  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.786505  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.733251  9905 consensus_queue.cc:1048] T 28b049654a98498cb575cc50eb45a7f9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:57.733331  9795 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:57.726662  9414 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.732721  9704 consensus_queue.cc:1048] T af028603c5e74d4c8e598da3c03999d8 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:15:57.694089  8473 rpcz_store.cc:276] 0709 12:15:56.518506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.689814 (+171308us) service_pool.cc:224] Handling call
0709 12:15:56.690112 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.870252 (+180140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.884853 (+ 14601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:57.028262 (+143409us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.286536 (+258274us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:57.519618 (+233082us) log.cc:844] Serialized 14 byte log entry
0709 12:15:57.579307 (+ 59689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.579443 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.644713 (+ 65270us) raft_consensus.cc:1685] finished
0709 12:15:57.644747 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:57.655311 (+ 10564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97950,"prepare.queue_time_us":83195,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":159207,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":9929,"thread_start_us":347755,"threads_started":2,"wal-append.queue_time_us":301115}
I20260709 12:15:57.636900  9814 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.740742  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.742779  9917 consensus_queue.cc:1059] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:57.743942  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.744858  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:57.746044  9875 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.693696  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.781463  8398 raft_consensus.cc:2410] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:57.784226  9911 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.732831  9809 consensus_queue.cc:1059] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:57.786937  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.724851  9930 raft_consensus.cc:493] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:57.797868  9870 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:15:57.814308  9889 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:57.798707  9914 log.cc:927] Time spent T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:15:57.675789  9900 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.808156  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:57.780423  9794 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:57.773866  8249 raft_consensus.cc:2468] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 6.
I20260709 12:15:57.812768  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:57.800747  9924 log.cc:927] Time spent T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:15:57.818395  8479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 311) took 2351 ms (client timeout 2454 ms). Trace:
W20260709 12:15:57.928690  8479 rpcz_store.cc:269] 0709 12:15:55.466684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:55.511034 (+ 44350us) service_pool.cc:224] Handling call
0709 12:15:57.818139 (+2307105us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002c4cd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:57.818311 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484801920}
I20260709 12:15:57.819502  8480 raft_consensus.cc:1240] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 8 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260709 12:15:57.820604  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 294438us
I20260709 12:15:57.827124  9927 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:15:57.831946  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.837968  8472 raft_consensus.cc:2393] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 4: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:15:57.851334  8296 leader_election.cc:304] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:57.834666  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:57.809218  9414 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.693367  9909 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:57.884682  8253 raft_consensus.cc:1240] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:15:57.921239  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:57.927227  8327 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:57.676239  9940 consensus_queue.cc:1059] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 12:15:57.925336  8221 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:57.932039  8298 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:57.643050  9651 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.875640  9930 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:15:57.941928  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 211226us
I20260709 12:15:57.936383  9646 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.837850  9875 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.945000  9921 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:57.948490  8372 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:58.011554  8323 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 3.
W20260709 12:15:58.011845  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 211329us
I20260709 12:15:58.016942  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:58.050956  8256 raft_consensus.cc:2410] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:15:58.051133  9947 log.cc:927] Time spent T 1928b0c529924067acf1990936762a6e P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:15:58.051637  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 271) took 1139 ms. Trace:
W20260709 12:15:58.051810  9946 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:15:58.051983  9900 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:57.995661  8324 raft_consensus.cc:2468] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:57.949162  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:58.047290  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:58.048257  9646 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.085422  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.086794  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:57.990549  9928 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
W20260709 12:15:58.054327  9748 consensus_meta.cc:287] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 1.000s	user 0.014s	sys 0.000s
I20260709 12:15:58.087548  9646 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.087634  8253 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:58.088020  9748 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.087679  9921 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.015728  9771 consensus_queue.cc:1048] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:15:58.044445  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 339) took 1095 ms. Trace:
I20260709 12:15:57.941733  9794 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.015946  9767 consensus_queue.cc:1048] T dbbdda706773489c8f1e9db5d6e9254d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:15:58.055641  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:58.055547  8250 raft_consensus.cc:2410] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:58.052019  8256 rpcz_store.cc:276] 0709 12:15:56.912466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.007661 (+ 95195us) service_pool.cc:224] Handling call
0709 12:15:58.016730 (+1009069us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:58.051573 (+ 34843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4805504}
I20260709 12:15:57.988704  9782 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.103245  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.103349  9782 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.095642  9900 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.105165  9900 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.106098  9782 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.107788  9969 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.108384  9964 raft_consensus.cc:3060] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:58.108296  9969 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.110451  9969 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.110962  9969 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:58.111863  9962 raft_consensus.cc:493] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.112383  9962 raft_consensus.cc:515] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:58.079929  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 147977us
W20260709 12:15:58.083984  8471 consensus_meta.cc:287] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.003s
I20260709 12:15:58.114079  8471 raft_consensus.cc:1275] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:15:58.114410  8471 pending_rounds.cc:85] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Aborting all ops after (but not including) 2
I20260709 12:15:58.057211  8254 raft_consensus.cc:1275] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:58.084695  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 232) took 1024 ms. Trace:
I20260709 12:15:58.085281  9414 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:58.033169  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 181934us
I20260709 12:15:58.085264  9814 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:58.094918  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.135365  9414 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.090246  8472 raft_consensus.cc:1240] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:58.136163  9414 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:57.999323  9953 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.138504  9953 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.139530  9414 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:58.101186  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 152791us
I20260709 12:15:58.140149  9704 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:58.140911  9704 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.142103  8372 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.101509  9794 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.143491  9794 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:58.143314  9956 consensus_queue.cc:1059] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:58.144305  9794 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.144889  9794 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.144925  9956 raft_consensus.cc:3055] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:58.145568  9956 raft_consensus.cc:740] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:58.101855  9905 raft_consensus.cc:2749] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.089715  8257 rpcz_store.cc:276] 0709 12:15:56.949409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.182908 (+233499us) service_pool.cc:224] Handling call
0709 12:15:57.183205 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.217716 (+ 34511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:57.217764 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:57.218366 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.342859 (+124493us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:57.342918 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.343031 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.044048 (+701017us) raft_consensus.cc:1685] finished
0709 12:15:58.044069 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.044341 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34047,"raft.queue_time_us":50394,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":124128,"threads_started":1,"wal-append.queue_time_us":445289}
I20260709 12:15:58.148805  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:58.146581  9956 consensus_queue.cc:260] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.124835  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.114593  9962 leader_election.cc:290] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.114670  8471 pending_rounds.cc:107] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:15:58.152151  8471 raft_consensus.cc:2889] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:58.152218  8402 raft_consensus.cc:2393] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 4: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
W20260709 12:15:58.101042  9942 log.cc:927] Time spent T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:15:58.150553  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:58.150593  9956 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:58.170008  8402 raft_consensus.cc:1240] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
W20260709 12:15:58.171809  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 246594us
I20260709 12:15:58.096256  9948 raft_consensus.cc:3055] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:58.175007  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.084053  9751 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:58.175611  9788 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:15:58.117938  9940 raft_consensus.cc:2749] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:15:58.179587  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.115145  8477 rpcz_store.cc:276] 0709 12:15:57.060468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.169655 (+109187us) service_pool.cc:224] Handling call
0709 12:15:57.249013 (+ 79358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:57.315208 (+ 66195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:57.318516 (+  3308us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:57.416736 (+ 98220us) log.cc:844] Serialized 52 byte log entry
0709 12:15:57.654727 (+237991us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:57.654809 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.661601 (+  6792us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.057429 (+395828us) raft_consensus.cc:1685] finished
0709 12:15:58.084460 (+ 27031us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.084627 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8862,"raft.queue_time_us":51368,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":10369,"thread_start_us":137053,"threads_started":1,"wal-append.queue_time_us":565583}
W20260709 12:15:58.201675  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 77906.7us
I20260709 12:15:58.167124  9964 raft_consensus.cc:2749] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.131815  8397 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:58.179019  9814 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.212867  8330 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:58.179996  9948 raft_consensus.cc:740] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:58.242110  8370 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:58.183284  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 227) took 1549 ms. Trace:
I20260709 12:15:58.183472  9928 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.253062  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.221714  9704 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.264406  9909 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.235891  9900 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
W20260709 12:15:58.273940  9955 log.cc:927] Time spent T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:15:58.275255  9911 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.259510  9928 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
    @     0x7f124a6c6930 google::LogMessage::Flush() at ??:0
I20260709 12:15:58.257699  9748 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.244663  9809 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.281075  9957 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:58.277549  9948 consensus_queue.cc:260] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.281898  9948 raft_consensus.cc:3060] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:58.282470  9895 log.cc:927] Time spent T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 1.337s	user 0.006s	sys 0.000s
I20260709 12:15:58.283747  8328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 240) took 1670 ms. Trace:
I20260709 12:15:58.272557  9704 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.284093  9921 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.284482  9704 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.284942  9979 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.284230  8328 rpcz_store.cc:276] 0709 12:15:56.613477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.613635 (+   158us) service_pool.cc:224] Handling call
0709 12:15:56.613986 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.614336 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.614367 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:56.614850 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:15:56.683723 (+ 68873us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:56.683760 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:56.683822 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.281812 (+1597990us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:15:58.283423 (+  1611us) raft_consensus.cc:1685] finished
0709 12:15:58.283447 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.283687 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7414,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":49719040,"thread_start_us":44198,"threads_started":1,"wal-append.queue_time_us":122524}
I20260709 12:15:58.294229  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.294512  9704 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.294963  8328 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:58.296223  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.297436  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.297997  8328 raft_consensus.cc:2468] T dbbdda706773489c8f1e9db5d6e9254d P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:58.291245  9957 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.299113  9651 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.253240  8471 rpcz_store.cc:276] 0709 12:15:56.629284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.736720 (+107436us) service_pool.cc:224] Handling call
0709 12:15:56.748486 (+ 11766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.153035 (+1404549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.178530 (+ 25495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:15:58.298795  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.246236  9814 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:15:58.328928  8372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.329716  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:58.301590  8220 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:58.315230  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.330613  8253 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:58.278798  8324 raft_consensus.cc:1240] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:15:58.300438  9809 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.331879  8328 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
W20260709 12:15:58.316869  9959 log.cc:927] Time spent T f0eeb9a483c44c6394dbf7aa57e178a3 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:15:58.318611  9661 raft_consensus.cc:3055] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:58.343314  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:58.344908  8222 leader_election.cc:304] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.348349  8372 leader_election.cc:304] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.336404  9750 raft_consensus.cc:3055] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:58.350049  9750 raft_consensus.cc:740] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:58.299520  9957 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.397980  8220 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:58.395982  9751 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:58.419420  9751 raft_consensus.cc:493] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.419976  9751 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.342408  9661 raft_consensus.cc:740] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:58.424654  9809 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.424198  9661 consensus_queue.cc:260] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 1, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.407812  9414 raft_consensus.cc:2804] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:15:58.409096  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 64339us
W20260709 12:15:58.436818  9977 log.cc:927] Time spent T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:15:58.406970  9750 consensus_queue.cc:260] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.428478  9782 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:15:58.441936  9949 log.cc:927] Time spent T af028603c5e74d4c8e598da3c03999d8 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:15:58.407603  9748 raft_consensus.cc:493] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
W20260709 12:15:58.444689  9965 log.cc:927] Time spent T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:15:58.426185  9661 raft_consensus.cc:3060] T 3344c86d5a404f19a609fac8030806a9 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.417173  9918 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:58.275288  9952 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 12:15:58.430737  9414 raft_consensus.cc:493] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.450474  9794 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.451581  9784 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:15:58.442117  9910 consensus_meta.cc:287] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7: Time spent flushing consensus metadata: real 0.861s	user 0.003s	sys 0.009s
I20260709 12:15:58.458082  8329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 249) took 1095 ms. Trace:
I20260709 12:15:58.460698  9983 raft_consensus.cc:2804] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:58.464182  9957 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.465795  9814 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.470427  8399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 400) took 1361 ms. Trace:
I20260709 12:15:58.534778  8399 rpcz_store.cc:276] 0709 12:15:57.108881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.119488 (+ 10607us) service_pool.cc:224] Handling call
0709 12:15:57.119841 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:57.122069 (+  2228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.470158 (+1348089us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b54001cf0a0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e064dc0 00007f124e0f0a02 00007f124e0ecdd6 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2
0709 12:15:58.470362 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15114624}
I20260709 12:15:58.475549  9781 raft_consensus.cc:3055] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:58.486379  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 269) took 1574 ms. Trace:
I20260709 12:15:58.487876  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:58.538172  8252 rpcz_store.cc:276] 0709 12:15:56.911901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.173587 (+261686us) service_pool.cc:224] Handling call
0709 12:15:58.485366 (+1311779us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b58002e3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:58.485628 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.485834 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.485862 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:58.485910 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:58.486115 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.486180 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.486311 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9765760}
W20260709 12:15:58.540843  8476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42044 (request call id 317) took 1555 ms (client timeout 1928 ms). Trace:
W20260709 12:15:58.489750  9925 log.cc:927] Time spent T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 1.096s	user 0.005s	sys 0.000s
I20260709 12:15:58.312606  9979 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.494371  9804 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.496810  8398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 397) took 1474 ms. Trace:
I20260709 12:15:58.498358  8222 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.508739  9967 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.510280  9750 raft_consensus.cc:3060] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:58.504798  9782 raft_consensus.cc:493] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.511204  9748 raft_consensus.cc:515] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.513360  8474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 230) took 1758 ms. Trace:
I20260709 12:15:58.517889  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.606330  8405 raft_consensus.cc:2468] T 6f757a1a65af43d8b4c8996f392e3bfd P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:58.523293  8329 rpcz_store.cc:276] 0709 12:15:57.362464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.362615 (+   151us) service_pool.cc:224] Handling call
0709 12:15:57.362920 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.601201 (+238281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.457756 (+856555us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540046c654. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:58.458004 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457378176}
W20260709 12:15:58.541230  8476 rpcz_store.cc:269] 0709 12:15:56.985632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.985787 (+   155us) service_pool.cc:224] Handling call
0709 12:15:58.487710 (+1501923us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b58007c3298. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:58.540779 (+ 53069us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7745664}
I20260709 12:15:58.540093  9983 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:58.542904  8398 rpcz_store.cc:276] 0709 12:15:57.022640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.024549 (+  1909us) service_pool.cc:224] Handling call
0709 12:15:58.496573 (+1472024us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54005c4ed4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:58.496744 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692590976}
I20260709 12:15:58.525689  9414 raft_consensus.cc:3060] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.537943  9781 raft_consensus.cc:740] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:15:58.602187  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 360178us
I20260709 12:15:58.534876  9956 raft_consensus.cc:493] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.525117  9912 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:58.546969  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 48724.6us
I20260709 12:15:58.624929  8370 leader_election.cc:304] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:58.608686  8297 leader_election.cc:304] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.538182  9910 raft_consensus.cc:2749] T 830be490ae644f67b4bf87248e3bb615 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:58.589630  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.552970  9782 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.554351  9752 raft_consensus.cc:2749] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.605829  8474 rpcz_store.cc:276] 0709 12:15:56.755471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.761247 (+  5776us) service_pool.cc:224] Handling call
0709 12:15:56.761696 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:56.871967 (+110271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:56.872011 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:56.931328 (+ 59317us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.561318 (+629990us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003a2f40. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d0d1 00007f124e0a8a0f
0709 12:15:57.809375 (+248057us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:57.809444 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.809562 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:58.513035 (+703473us) raft_consensus.cc:1685] finished
0709 12:15:58.513062 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.513296 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155735,"raft.queue_time_us":110707,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":11948,"spinlock_wait_cycles":45574400,"thread_start_us":247809,"threads_started":1,"wal-append.queue_time_us":1042099}
I20260709 12:15:58.627282  8222 leader_election.cc:304] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.635313  9918 raft_consensus.cc:2749] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:58.634820  9957 consensus_queue.cc:1048] T ab17d74d3fe844ee9def403591842530 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:58.629621  9956 raft_consensus.cc:515] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.639626  8222 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:58.623467  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 275214us
I20260709 12:15:58.645366  8222 leader_election.cc:304] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.651845  9951 raft_consensus.cc:493] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.656471  9951 raft_consensus.cc:515] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.628930  9804 raft_consensus.cc:2749] T 23b9669b9bee44ffa43fecf53ed6ca9f P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.638176  9911 raft_consensus.cc:2804] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:58.651257  9647 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:58.708328  9647 raft_consensus.cc:493] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.708935  9647 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.618836  9983 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.665472  9952 consensus_queue.cc:1048] T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:58.644853  9912 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.672338  9956 leader_election.cc:290] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.674901  9748 leader_election.cc:290] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.677018  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.664060  9752 raft_consensus.cc:2749] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:58.681456  9951 leader_election.cc:290] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.682022  9966 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.687799  9782 raft_consensus.cc:515] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.693569  9781 consensus_queue.cc:260] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.628923  9979 leader_election.cc:290] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.705108  9911 raft_consensus.cc:493] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.603946  9967 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:58.723424  9930 consensus_meta.cc:287] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.003s
I20260709 12:15:58.706285  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.706365  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.680984  9414 raft_consensus.cc:515] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:58.734907  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 81170.5us
I20260709 12:15:58.736066  8222 leader_election.cc:304] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.737668  8222 leader_election.cc:304] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.739015  9752 raft_consensus.cc:2749] T 1928b0c529924067acf1990936762a6e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.641305  9986 consensus_queue.cc:1059] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:15:58.725052  9918 raft_consensus.cc:493] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.739872  8222 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.740931  8401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54490 (request call id 483) took 1434 ms. Trace:
I20260709 12:15:58.749115  8480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 350) took 2231 ms. Trace:
I20260709 12:15:58.749459  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.750550  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.732921  9911 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.743767  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 273) took 1830 ms. Trace:
I20260709 12:15:58.746557  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.750694  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.735946  9781 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.753721  8255 rpcz_store.cc:276] 0709 12:15:56.913047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.124558 (+211511us) service_pool.cc:224] Handling call
0709 12:15:58.743611 (+1619053us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400269b54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:58.743709 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37986560}
I20260709 12:15:58.731678  9966 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.754843  8406 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:58.755308  8255 raft_consensus.cc:1240] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:15:58.756074  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.758262  9705 raft_consensus.cc:3055] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:58.758802  9705 raft_consensus.cc:740] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:58.749528  8480 rpcz_store.cc:276] 0709 12:15:56.517771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:56.688210 (+170439us) service_pool.cc:224] Handling call
0709 12:15:57.819144 (+1130934us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:57.930150 (+111006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.748916 (+818766us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002c4cd0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:58.749053 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599671552}
I20260709 12:15:58.759768  9705 consensus_queue.cc:260] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.760882  9705 raft_consensus.cc:3060] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.761822  9912 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.766446  9414 leader_election.cc:290] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.753168  9918 raft_consensus.cc:515] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.768369  9782 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.773198  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.741485  9948 raft_consensus.cc:2749] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:58.775354  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.747984  9784 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:58.779059  8326 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:58.747843  8401 rpcz_store.cc:276] 0709 12:15:57.306371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.311376 (+  5005us) service_pool.cc:224] Handling call
0709 12:15:58.688827 (+1377451us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b58007b4898. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8e9c 00007f124afc8a5b 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530b30a0 00007f12530b2984 00007f124c62d6d4 00007f124c62d662
0709 12:15:58.740866 (+ 52039us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108736}
I20260709 12:15:58.778259  8222 leader_election.cc:304] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.783241  8222 leader_election.cc:304] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.734046  9930 raft_consensus.cc:515] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.776285  9794 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.787037  8222 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.785247  9912 raft_consensus.cc:2749] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.788089  9923 raft_consensus.cc:2749] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:58.790886  9899 raft_consensus.cc:3055] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:58.791364  9899 raft_consensus.cc:740] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:58.792131  9899 consensus_queue.cc:260] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.795598  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.793619  9899 raft_consensus.cc:3060] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.797700  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.800700  8404 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:58.800825  8249 raft_consensus.cc:1240] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:58.797832  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.785305  9784 raft_consensus.cc:2749] T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:58.808178  9647 raft_consensus.cc:515] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.811190  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.812300  8331 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
W20260709 12:15:58.816921  8221 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.821277  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.822211  8331 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
W20260709 12:15:58.824407  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:58.825685  8331 raft_consensus.cc:1275] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:15:58.811326  9967 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.827509  9414 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.828088  9414 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.828914  9930 leader_election.cc:290] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.830205  9414 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.831329  9966 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.831594  9659 leader_election.cc:290] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.831667  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.833559  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.834226  8399 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:58.835283  8298 leader_election.cc:304] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:58.836894  8298 leader_election.cc:304] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c
I20260709 12:15:58.838058  9967 raft_consensus.cc:2804] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:58.838582  9967 raft_consensus.cc:493] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.839064  9967 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:58.836385  8222 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.843122  9983 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:58.844429  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 93125.2us
I20260709 12:15:58.844920  8328 raft_consensus.cc:1275] T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:58.846531  9918 leader_election.cc:290] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.847240  9921 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:58.847118  9986 consensus_queue.cc:1059] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:58.847736  9921 raft_consensus.cc:493] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.848234  9921 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.849673  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:58.851414  9918 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.852909  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.853628  8404 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:58.851593  9991 raft_consensus.cc:3055] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:58.854542  9991 raft_consensus.cc:740] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:58.856017  9647 leader_election.cc:290] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.857446  8297 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.834372  9751 raft_consensus.cc:515] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.858527  9962 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:58.852799  9860 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.859057  9962 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.849355  9966 raft_consensus.cc:2804] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:58.859675  9962 raft_consensus.cc:3060] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:58.860062  9966 raft_consensus.cc:493] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.860699  9966 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:58.852006  9918 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.859678  9991 consensus_queue.cc:260] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.867244  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.859689  9860 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.872437  9795 raft_consensus.cc:3055] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:58.864804  9751 leader_election.cc:290] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.875172  8369 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:58.866393  9991 raft_consensus.cc:3060] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.881002  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:58.881788  8328 raft_consensus.cc:3060] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.879079  8369 leader_election.cc:304] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.880388  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.884302  8404 raft_consensus.cc:3060] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.883294  9814 raft_consensus.cc:493] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:58.885875  9814 raft_consensus.cc:515] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:58.875499  9875 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.884861  9990 raft_consensus.cc:2804] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:58.887485  9990 raft_consensus.cc:493] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:58.885248  8325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58520 (request call id 354) took 1714 ms. Trace:
I20260709 12:15:58.873101  9795 raft_consensus.cc:740] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:15:58.893373  9983 leader_election.cc:290] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.894976  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:58.896560  8401 raft_consensus.cc:1240] T d75f6416846c431394d73267f34045a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:58.890654  8328 raft_consensus.cc:2468] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
I20260709 12:15:58.887898  9990 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:58.878371  9979 raft_consensus.cc:2749] T 000cbbc93f224c7abbc8fc7d61b4e191 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:58.891825  8325 rpcz_store.cc:276] 0709 12:15:57.171294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.172510 (+  1216us) service_pool.cc:224] Handling call
0709 12:15:58.884450 (+1711940us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:58.884673 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.884856 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.884885 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:58.884928 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:58.884978 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.885045 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.885182 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42569088}
I20260709 12:15:58.888968  8369 leader_election.cc:304] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.891371  9903 consensus_queue.cc:1048] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:15:58.905588  8297 leader_election.cc:304] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
    @     0x7f124a6cba6b google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260709 12:15:58.917516  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58524 (request call id 257) took 1086 ms. Trace:
W20260709 12:15:58.924192  9989 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:15:58.910910  9771 raft_consensus.cc:2804] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:58.924798  9681 raft_consensus.cc:2804] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:58.925027  9771 raft_consensus.cc:493] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.925311  9681 raft_consensus.cc:493] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:58.925616  9771 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.925814  9681 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:58.924288  8323 rpcz_store.cc:276] 0709 12:15:57.831438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.831600 (+   162us) service_pool.cc:224] Handling call
0709 12:15:58.917277 (+1085677us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54003c82d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:58.917420 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167824256}
I20260709 12:15:58.932489  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:58.933168  8404 raft_consensus.cc:2468] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:58.901778  9928 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.934654  8222 leader_election.cc:304] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:58.902017  9911 raft_consensus.cc:515] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:58.894872  9814 leader_election.cc:290] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:58.916790  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 346) took 1581 ms. Trace:
I20260709 12:15:58.929927  9939 raft_consensus.cc:3055] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:58.940132  9952 raft_consensus.cc:2804] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:58.900776  9907 consensus_queue.cc:1059] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:15:58.928298  9979 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:15:58.951536  8400 raft_consensus.cc:1240] T 53cf6c47fc2b43f69bbc266d55353c9a P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:58.954041  9911 leader_election.cc:290] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:58.943192  8254 rpcz_store.cc:276] 0709 12:15:57.335424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.728171 (+392747us) service_pool.cc:224] Handling call
0709 12:15:57.984516 (+256345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.115040 (+130524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:58.916402 (+801362us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540053ded0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:58.916681 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421956864}
I20260709 12:15:58.956236  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:58.910826  9986 consensus_queue.cc:1048] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:15:58.960594  9952 raft_consensus.cc:697] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:58.951922  9939 raft_consensus.cc:740] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:15:58.893385  9795 consensus_queue.cc:260] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.950312  9928 raft_consensus.cc:493] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:58.969889  9911 raft_consensus.cc:3055] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:58.967063  9860 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:58.968307  9814 consensus_queue.cc:1059] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:58.982411  9954 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:58.984957  9795 raft_consensus.cc:3060] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:58.987272  9911 raft_consensus.cc:740] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:59.002002  9911 consensus_queue.cc:260] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.003270  9911 raft_consensus.cc:3060] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:59.003407  8296 leader_election.cc:304] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.005484  8296 leader_election.cc:304] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.006261  9902 raft_consensus.cc:2749] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:59.006681  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.008406  8329 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:58.984685  9928 raft_consensus.cc:515] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.008857  8328 raft_consensus.cc:1275] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:59.006102  8324 raft_consensus.cc:1240] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:15:58.995920  9918 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:58.987654  9966 raft_consensus.cc:515] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.009248  9902 raft_consensus.cc:3060] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.011018  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:59.007001  9748 consensus_queue.cc:1059] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:15:58.968573  9939 consensus_queue.cc:260] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.017580  9967 raft_consensus.cc:515] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:58.970619  9952 consensus_queue.cc:237] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:58.998121  9954 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.022085  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028c831fc6fe4bc3a5dacb16c136884b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:59.024771  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.106278  8248 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:15:59.027479  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 369) took 1151 ms. Trace:
I20260709 12:15:59.027956  9791 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:59.030151  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:59.034706  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.035627  9707 raft_consensus.cc:493] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:59.052875  8298 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:59.087749  8445 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:59.088444  8443 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.091406  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.114459  8331 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 6.
I20260709 12:15:59.115901  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbdda706773489c8f1e9db5d6e9254d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:59.056849  9897 raft_consensus.cc:493] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:59.106774  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.087312  9646 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.107264  8472 rpcz_store.cc:276] 0709 12:15:57.875747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.137229 (+261482us) service_pool.cc:224] Handling call
0709 12:15:58.137750 (+   521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:58.161708 (+ 23958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.161756 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:58.162527 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 12:15:58.336412 (+173885us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:58.413738 (+ 77326us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.026874 (+613136us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b180040c9c0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124af7ac0a 00007f12546ba219 00007f124b002a40 00007f124affd4e4 00007f124affd455 00007f124e0e5060 00007f124e0f7716 00007f124e108287 00007f124e108208
0709 12:15:59.027091 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.027163 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.027204 (+    41us) raft_consensus.cc:1685] finished
0709 12:15:59.027285 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.027423 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87652,"prepare.queue_time_us":76926,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":641439,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":10702,"spinlock_wait_cycles":6268800,"thread_start_us":125677,"threads_started":1,"wal-append.queue_time_us":310933}
W20260709 12:15:59.118120  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 65355.4us
I20260709 12:15:59.118503  8328 raft_consensus.cc:1240] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:15:59.124027  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:59.125027  8221 leader_election.cc:336] T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085): Timed out: RequestConsensusVote RPC to 127.3.34.196:42085 timed out after 1.886s (SENT)
W20260709 12:15:59.125510  8298 leader_election.cc:336] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731): Timed out: RequestConsensusVote RPC to 127.3.34.193:41731 timed out after 2.093s (SENT)
I20260709 12:15:59.125598  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.125972  8298 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
W20260709 12:15:59.118587  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 65870.2us
I20260709 12:15:59.110562  8326 raft_consensus.cc:1240] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:15:59.117985  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.103205  9748 raft_consensus.cc:3055] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:59.129554  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:59.130362  8329 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 6: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:59.131116  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.131889  8329 raft_consensus.cc:2410] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:15:59.105593  9918 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.034722  9681 raft_consensus.cc:515] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.113468  9771 raft_consensus.cc:515] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.113656  9791 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.118270  9788 raft_consensus.cc:493] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.129727  9748 raft_consensus.cc:740] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:59.141729  8446 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
I20260709 12:15:59.148084  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.086712  9962 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.154201  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.158226  8475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 231) took 2098 ms. Trace:
I20260709 12:15:59.183316  8475 rpcz_store.cc:276] 0709 12:15:57.059704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.092850 (+ 33146us) service_pool.cc:224] Handling call
0709 12:15:57.142515 (+ 49665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:57.164605 (+ 22090us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:57.327642 (+163037us) log.cc:844] Serialized 14 byte log entry
0709 12:15:57.454039 (+126397us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:57.461093 (+  7054us) log.cc:844] Serialized 26 byte log entry
0709 12:15:57.461232 (+   139us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:57.461266 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:57.461340 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:57.561366 (+100026us) raft_consensus.cc:1685] finished
0709 12:15:57.561385 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:58.854486 (+1293101us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b48002604d8. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253016aa1 00007f125300db37 00007f125300d9ca 00007f125310526f 00007f1253104f37 00007f125311955c 00007f1253119508 00007f1253119488 00007f1253119443 00007f12531186ec 00007f1252042a96
0709 12:15:59.158024 (+303538us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5400073350. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:59.158158 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203665,"prepare.queue_time_us":208736,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":167883,"raft.run_cpu_time_us":7615,"raft.run_wall_time_us":1345370,"spinlock_wait_cycles":140479744,"thread_start_us":245749,"threads_started":2,"wal-append.queue_time_us":217219,"wal-append.run_cpu_time_us":2605,"wal-append.run_wall_time_us":1042454}
I20260709 12:15:59.113865  9834 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.185916  9834 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.186090  8220 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:59.187390  9771 leader_election.cc:290] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.172856  9885 raft_consensus.cc:493] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.188238  9834 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.188632  9885 raft_consensus.cc:515] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.189074  8478 raft_consensus.cc:1275] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:59.118664  9661 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.169785  8480 raft_consensus.cc:1275] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:59.144613  9961 consensus_queue.cc:1048] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:59.190730  9661 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.171841  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.129226  9951 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:59.177862  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.178534  9791 leader_election.cc:290] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.179056  8474 raft_consensus.cc:1275] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:59.179591  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.179877  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.150915  9814 raft_consensus.cc:2749] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:59.197486  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.195937  8298 leader_election.cc:304] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.211792  8398 raft_consensus.cc:2468] T 0fde30635c7f45dead7584c98d2d807d P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 3.
I20260709 12:15:59.146284  9956 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:59.188045 10007 log.cc:927] Time spent T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:59.217782  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53cf6c47fc2b43f69bbc266d55353c9a" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:59.173691  9969 raft_consensus.cc:3055] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:59.147728  9646 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.197221  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66cbe0fda224c11a64b3afe9df50f1e" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:59.228554  8329 raft_consensus.cc:3060] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:59.213286  8222 leader_election.cc:304] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:59.218603  8253 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:59.192914  9661 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.199108  9705 raft_consensus.cc:493] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.122841  9707 raft_consensus.cc:515] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.208385  9937 raft_consensus.cc:493] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:15:59.192194  9954 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.198820  9899 raft_consensus.cc:493] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.158705  9903 consensus_queue.cc:1048] T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:15:59.202342  9951 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.202602  9727 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
W20260709 12:15:59.236583  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 50607.4us
I20260709 12:15:59.240159  8474 raft_consensus.cc:1275] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:59.263413  8445 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.264490  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.264598  8445 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.265723  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.240475  8329 raft_consensus.cc:2468] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 6.
I20260709 12:15:59.129519  9897 raft_consensus.cc:515] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.162006  9918 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.213630  9932 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:59.200760  9788 raft_consensus.cc:515] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.219069  9956 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.190953  9885 leader_election.cc:290] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.217312  9950 raft_consensus.cc:2749] T 28270200f56944ca899873c119f8ae9b P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:59.218195  8473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.267822  8329 raft_consensus.cc:1240] T 6f757a1a65af43d8b4c8996f392e3bfd P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:59.293566  8253 raft_consensus.cc:2468] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
I20260709 12:15:59.268919  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.294896  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.221810  9969 raft_consensus.cc:740] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:59.271100  8445 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.275115  8220 leader_election.cc:304] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:59.278168  8372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.251544  9990 raft_consensus.cc:515] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.241204  9751 raft_consensus.cc:2804] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:59.241495  9647 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:15:59.259357  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.246317  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.273754  9727 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.331393  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.285457  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e104b0cfb404501a9910825b4ee355c" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.249091  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.332808  9727 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.332995  8474 raft_consensus.cc:3060] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:59.285549  8325 raft_consensus.cc:1240] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:59.272830  9661 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:59.333668  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.334311  8478 raft_consensus.cc:2468] T ae4f4f07bd32437a98ac789ece17a21b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
I20260709 12:15:59.334511  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.335151  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31de02a86b3d49d1af63827598c1a76a" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.335520  8398 raft_consensus.cc:1240] T 2f7d306897264222a2d589b45d592dce P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:59.338042  9912 consensus_queue.cc:1059] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:59.338830  8221 leader_election.cc:304] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.339071  9912 raft_consensus.cc:3055] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:15:59.339511  9912 raft_consensus.cc:740] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:59.263113  9951 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.339921  9954 raft_consensus.cc:2749] T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:59.340374  9912 consensus_queue.cc:260] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:59.298082  8296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.285640  9932 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.279624  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.241478  9937 raft_consensus.cc:515] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.241619  9705 raft_consensus.cc:515] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.301793  8220 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7
W20260709 12:15:59.347687  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 45978.3us
I20260709 12:15:59.348999  8220 leader_election.cc:304] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:59.350485  8220 leader_election.cc:304] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.261569  9899 raft_consensus.cc:515] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.310452  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:59.312340 10012 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 35617b9c10ad4daa80878f0de881422c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:15:59.341720  9912 raft_consensus.cc:3060] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:59.314020  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.315137  9928 leader_election.cc:290] T 32248472abc44c9bba02ee8e40ec7475 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.315805  9707 leader_election.cc:290] T 23b9669b9bee44ffa43fecf53ed6ca9f P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.316542  9918 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.322679  9990 leader_election.cc:290] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 7 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.323410  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.325050  9897 leader_election.cc:290] T 32666a4a15904513a3c010c3fa185950 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.325521  9966 leader_election.cc:290] T f7a74bd0d6094fc497a5fd124956f81b P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.284756  9748 consensus_queue.cc:260] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.306363  9647 raft_consensus.cc:493] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.328327  9646 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.303965  9751 raft_consensus.cc:493] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.309441  9791 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:59.329726  8332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 256) took 1511 ms. Trace:
I20260709 12:15:59.417309  8332 rpcz_store.cc:276] 0709 12:15:57.818754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.821345 (+  2591us) service_pool.cc:224] Handling call
0709 12:15:59.328778 (+1507433us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b5800127b98. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124afc8b71 00007f124afc8a22 00007f1253ee18d9 00007f125303bee0 00007f12531050ab 00007f1253105131 00007f12530c6fc0 00007f12530b1929 00007f12530b13d2 00007f124c628bd4
0709 12:15:59.329046 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:59.329284 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.329327 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:59.329383 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:59.329429 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.329522 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.329656 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10142080}
I20260709 12:15:59.341231  9967 leader_election.cc:290] T d488d21a9387402aa540f068f237a295 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 7 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.341866  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.336158  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.297211  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f757a1a65af43d8b4c8996f392e3bfd" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:15:59.344334  8221 leader_election.cc:304] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:59.304386  9995 raft_consensus.cc:2749] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:15:59.304833  8472 raft_consensus.cc:1275] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [term 2 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:59.357977  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.312348  9788 leader_election.cc:290] T 28b049654a98498cb575cc50eb45a7f9 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.345137  9932 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:59.441041  9705 leader_election.cc:290] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.442082  9956 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.345050  9916 raft_consensus.cc:493] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.443706  9916 raft_consensus.cc:515] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.445811  9646 raft_consensus.cc:2804] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:15:59.446231  9916 leader_election.cc:290] T cc19f18db497464596bb5dba990be7ce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.446305  9646 raft_consensus.cc:493] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.353096  9701 raft_consensus.cc:2749] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:15:59.369686  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.353971  9939 raft_consensus.cc:3060] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.384567  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:59.393182  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.400575  9647 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:59.393996  8400 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:59.386018  9918 raft_consensus.cc:2804] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:15:59.381122  9681 leader_election.cc:290] T 000cbbc93f224c7abbc8fc7d61b4e191 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.423748  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.423885  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eeb9a483c44c6394dbf7aa57e178a3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:59.426199  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 81961.2us
I20260709 12:15:59.395351  9727 raft_consensus.cc:493] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.430583  8255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.436314  9937 leader_election.cc:290] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.438148  9953 leader_election.cc:290] T 6ab2c9e336d64e36988aa8af9b916076 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.367278  8474 raft_consensus.cc:2468] T 9e104b0cfb404501a9910825b4ee355c P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 7.
I20260709 12:15:59.447638  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab17d74d3fe844ee9def403591842530" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:59.448237  8251 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 270) took 2536 ms (client timeout 2093 ms). Trace:
I20260709 12:15:59.397663  9707 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.380352  8477 raft_consensus.cc:2468] T c9125ef7208a4120bf84f3925d5d4521 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:59.420091  9751 raft_consensus.cc:3060] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.355368  9969 consensus_queue.cc:260] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:59.454766  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 104390us
W20260709 12:15:59.499686  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.476882  8443 leader_election.cc:304] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.455972  8257 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 6: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:59.457175  8222 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:15:59.538385  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 61733us
I20260709 12:15:59.538429  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.537680  8478 raft_consensus.cc:2468] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:15:59.541802  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.541960  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3888d0746f41bbbf7b6e82062d3e08" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.542762  9727 raft_consensus.cc:515] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:15:59.536769  8251 rpcz_store.cc:269] 0709 12:15:56.912188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.051661 (+139473us) service_pool.cc:224] Handling call
0709 12:15:59.448034 (+2396373us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54007f8ad4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:59.448169 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5332990848}
W20260709 12:15:59.544493  9921 consensus_meta.cc:287] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.007s
I20260709 12:15:59.545089  9897 raft_consensus.cc:2804] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:15:59.545367 10004 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.554s	user 0.003s	sys 0.002s
I20260709 12:15:59.546329  8256 raft_consensus.cc:1240] T dbbdda706773489c8f1e9db5d6e9254d P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:15:59.542404  8478 raft_consensus.cc:3060] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:59.430791  9899 leader_election.cc:290] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.538722  8253 raft_consensus.cc:2468] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 6.
I20260709 12:15:59.451301  9646 raft_consensus.cc:3060] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:15:59.548686  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10e178915634d25bc567779eda3fcce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:15:59.549592  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 91857.4us
I20260709 12:15:59.563784  8480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.550132  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.552644  8443 leader_election.cc:304] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:15:59.559684  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.565188  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.568703  8296 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:59.570262  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.570801  8474 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:59.571573  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.555416  9897 raft_consensus.cc:493] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.566146  9701 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.573346  9897 raft_consensus.cc:3060] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:59.573457  9701 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.575985  9701 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.577793  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.578944  8253 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:59.578738  8400 raft_consensus.cc:2468] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:15:59.580107  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.580662  8222 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:59.580746  8253 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:59.582705  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.585000  8478 raft_consensus.cc:2410] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:15:59.586380  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d77fccb2892a48378d8e5ae26eba6096" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.587925  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.589063  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 241) took 1629 ms. Trace:
I20260709 12:15:59.589253  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.589789  8327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58516 (request call id 458) took 1380 ms. Trace:
I20260709 12:15:59.560312  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 275) took 2100 ms. Trace:
I20260709 12:15:59.590684  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5925c1429975480998dca9d5db37b825" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
I20260709 12:15:59.593106  8478 raft_consensus.cc:2376] T 5925c1429975480998dca9d5db37b825 P 35617b9c10ad4daa80878f0de881422c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 8. Re-sending same reply.
I20260709 12:15:59.557533 10022 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:59.593652 10022 raft_consensus.cc:493] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.593997 10022 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:59.594437  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "438aca5a484b480e8aa3600500c15d5f" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.589514  8249 rpcz_store.cc:276] 0709 12:15:57.959731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.112562 (+152831us) service_pool.cc:224] Handling call
0709 12:15:58.112890 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:58.801306 (+688416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.588824 (+787518us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54005d57d4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:59.589007 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580044032}
I20260709 12:15:59.596607  8249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:15:59.599678 10013 log.cc:927] Time spent T dec01fc5fb0a43e6808551ad72c5d606 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:59.600332  8253 raft_consensus.cc:2468] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:59.600706  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 244) took 1639 ms. Trace:
I20260709 12:15:59.558161  9921 raft_consensus.cc:515] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.601251  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.601148  8256 rpcz_store.cc:276] 0709 12:15:57.961207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.510901 (+549694us) service_pool.cc:224] Handling call
0709 12:15:59.546090 (+1035189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:59.557506 (+ 11416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.600497 (+ 42991us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400269150. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:59.600648 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379774848}
I20260709 12:15:59.602455  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9125ef7208a4120bf84f3925d5d4521" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.602515  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.603103  9921 leader_election.cc:290] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:15:59.604425  8248 raft_consensus.cc:2393] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3421ee20b674b879e0633e39c5709d7 in current term 4: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:15:59.590337  8327 rpcz_store.cc:276] 0709 12:15:58.209008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.210590 (+  1582us) service_pool.cc:224] Handling call
0709 12:15:58.211050 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:59.020737 (+809687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.020766 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:59.021317 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 12:15:59.110761 (+ 89444us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:59.127445 (+ 16684us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.147307 (+ 19862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.589309 (+442002us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54003b1354. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:15:59.589383 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:59.589445 (+    62us) raft_consensus.cc:1685] finished
0709 12:15:59.589545 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:59.589718 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19420,"prepare.queue_time_us":6633,"prepare.run_wall_time_us":4056,"raft.queue_time_us":22116,"raft.run_cpu_time_us":3207,"raft.run_wall_time_us":445510,"spinlock_wait_cycles":1897821696,"thread_start_us":89099,"threads_started":1,"wal-append.queue_time_us":161755}
I20260709 12:15:59.606455  8248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:15:59.590377  9998 log.cc:927] Time spent T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.639s	user 0.000s	sys 0.005s
W20260709 12:15:59.614840  8296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 46233.9us
I20260709 12:15:59.603174  8253 raft_consensus.cc:2468] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:15:59.616025  8296 leader_election.cc:304] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.618705  9899 raft_consensus.cc:2749] T 028c831fc6fe4bc3a5dacb16c136884b P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:15:59.617089  8250 rpcz_store.cc:276] 0709 12:15:57.456042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:57.657609 (+201567us) service_pool.cc:224] Handling call
0709 12:15:59.545872 (+1888263us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400269154. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:15:59.556586 (+ 10714us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639077248}
I20260709 12:15:59.620666  8327 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 12:15:59.621194  8369 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.621845  8250 raft_consensus.cc:1275] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:15:59.622716  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.623551  8329 raft_consensus.cc:2468] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 5.
I20260709 12:15:59.625264  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:15:59.625972  8446 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: 
W20260709 12:15:59.626624  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 46089.2us
I20260709 12:15:59.548785  9918 raft_consensus.cc:697] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:59.628628  8296 leader_election.cc:304] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.626107  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:15:59.633083  8446 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.633188  8330 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:59.615978  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.635432  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.637815  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:15:59.640524  8296 leader_election.cc:304] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.644335  8296 leader_election.cc:304] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:15:59.658154  8296 leader_election.cc:304] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.660008  8296 leader_election.cc:304] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:15:59.546859  9707 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.666543  8248 raft_consensus.cc:1240] T 53cf6c47fc2b43f69bbc266d55353c9a P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: []
I20260709 12:15:59.670186  8296 leader_election.cc:304] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 29d436e9d3d54fe599d9aa67d38fba03
I20260709 12:15:59.671952  8330 raft_consensus.cc:2468] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3421ee20b674b879e0633e39c5709d7 in term 7.
I20260709 12:15:59.614557  9962 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.632128  9651 raft_consensus.cc:2804] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:59.673655  9704 raft_consensus.cc:493] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.679491  8251 raft_consensus.cc:1240] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:59.663499  9921 raft_consensus.cc:2804] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:59.635464  9839 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:59.663744  9911 raft_consensus.cc:2749] T df3888d0746f41bbbf7b6e82062d3e08 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:59.664335  9899 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:59.555514  9927 consensus_queue.cc:1048] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:15:59.666348  9953 raft_consensus.cc:2749] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:15:59.629403  9952 consensus_queue.cc:1059] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:15:59.666543  9681 raft_consensus.cc:2804] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:15:59.662904  9966 raft_consensus.cc:2749] T d10e178915634d25bc567779eda3fcce P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:59.676756  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faea1550226d4b32b5e0955096972f73" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:59.719383  8332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.678351  9967 raft_consensus.cc:2749] T d77fccb2892a48378d8e5ae26eba6096 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:15:59.715174  8330 raft_consensus.cc:1275] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:15:59.720299  8330 pending_rounds.cc:85] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Aborting all ops after (but not including) 2
I20260709 12:15:59.720578  8330 pending_rounds.cc:107] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:15:59.720840  8330 raft_consensus.cc:2889] T 438aca5a484b480e8aa3600500c15d5f P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:59.690387  9651 raft_consensus.cc:493] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.635028  9705 consensus_queue.cc:1048] T bedb2c9a19ab4ffbac05001cfcb9bf84 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:15:59.697162  9921 raft_consensus.cc:493] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35617b9c10ad4daa80878f0de881422c)
I20260709 12:15:59.673944  9932 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:15:59.731406  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 109459us
I20260709 12:15:59.708562  9962 raft_consensus.cc:2804] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:59.729786  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.734305  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8792e9c5a048e987bab09333071e2e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.734886  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.710938  9899 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.737911  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.738590  8403 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 6: Already voted for candidate b3421ee20b674b879e0633e39c5709d7 in this term.
I20260709 12:15:59.731534  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:59.718281  9681 raft_consensus.cc:493] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:59.719416  9916 raft_consensus.cc:493] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:59.717823  9913 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.726455  9651 raft_consensus.cc:3060] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:59.696004  9704 raft_consensus.cc:515] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.745828  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aebbe34acf2b4c6dbeb80e89dd1d5fc9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.735917  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:15:59.725819  9961 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.732604  9921 raft_consensus.cc:3060] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:59.746131  9681 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:59.796895  8480 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:15:59.745659  9962 raft_consensus.cc:697] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [term 8 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:59.749104  9952 raft_consensus.cc:3055] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:59.741459  9899 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:15:59.814469 10023 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:15:59.814329  9897 raft_consensus.cc:515] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.789091  9937 raft_consensus.cc:493] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:15:59.723948  9918 consensus_queue.cc:237] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.811424  9707 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.777568  9913 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.831426  9932 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 7 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:15:59.933899  8400 raft_consensus.cc:2468] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:15:59.937026  8297 leader_election.cc:304] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:15:59.938407  9907 raft_consensus.cc:2804] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:59.939129  9907 raft_consensus.cc:697] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [term 5 LEADER]: Becoming Leader. State: Replica: 70ae764f2abd44229023295f5cc6bf37, State: Running, Role: LEADER
I20260709 12:15:59.940636  9907 consensus_queue.cc:237] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:15:59.877081  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.884280  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.743438  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae4f4f07bd32437a98ac789ece17a21b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.885325  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff9ab56f09c438293e24be61ae38fb3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.886950  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbab756712a45979451545f2bc323f1" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:15:59.887094  8331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
W20260709 12:15:59.786597  8372 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:59.731070  8397 raft_consensus.cc:3060] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.022517  8325 raft_consensus.cc:2393] T 32666a4a15904513a3c010c3fa185950 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 6: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:16:00.022917  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8f3d635a3b46938c2710e672edf79d" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:16:00.023705  8325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:16:00.024528  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
I20260709 12:16:00.024946  8331 raft_consensus.cc:2393] T 6ed8246ac7e249fdae8fe1c01cba50f3 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:16:00.025383  8330 raft_consensus.cc:3060] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:00.025763  8256 raft_consensus.cc:1275] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:00.026216  8256 pending_rounds.cc:85] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Aborting all ops after (but not including) 1
I20260709 12:16:00.026275  9939 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.026543  8256 pending_rounds.cc:107] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:16:00.027293 10016 log.cc:927] Time spent T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
I20260709 12:16:00.027128  9939 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.751192  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b9669b9bee44ffa43fecf53ed6ca9f" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.030575  9939 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.710785  8473 raft_consensus.cc:1275] T 6da618d8bd7a4d3dbf914c3a6af98081 P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:15:59.751343  8476 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 in current term 7: Already voted for candidate 35617b9c10ad4daa80878f0de881422c in this term.
I20260709 12:16:00.039085  9707 consensus_queue.cc:1048] T 438aca5a484b480e8aa3600500c15d5f P 35617b9c10ad4daa80878f0de881422c [LEADER]: Connected to new peer: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:16:00.040351  8397 raft_consensus.cc:2468] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 4.
I20260709 12:16:00.041700  8401 raft_consensus.cc:1240] T faea1550226d4b32b5e0955096972f73 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:00.043934  8443 leader_election.cc:304] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
W20260709 12:16:00.046006  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 56415us
I20260709 12:15:59.745419  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28b049654a98498cb575cc50eb45a7f9" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:15:59.750133  8404 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:59.899173  9586 raft_consensus.cc:493] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.060237  9586 raft_consensus.cc:515] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:15:59.903733  9897 leader_election.cc:290] T 3d8f3d635a3b46938c2710e672edf79d P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.905889  9704 leader_election.cc:290] T 61fe6595501f4c619d61dedd4c8eb8b5 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.820281  9727 leader_election.cc:290] T bbb3616518e54d0295c345f3153cf62b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.836225  9921 raft_consensus.cc:515] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:15:59.803998  9647 raft_consensus.cc:515] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.815469  9952 raft_consensus.cc:740] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:15:59.909904  9954 raft_consensus.cc:2749] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:59.909924  8328 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:15:59.912333  9706 raft_consensus.cc:493] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 70ae764f2abd44229023295f5cc6bf37)
I20260709 12:15:59.873867  8254 raft_consensus.cc:1275] T f0eeb9a483c44c6394dbf7aa57e178a3 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:15:59.835429  9962 consensus_queue.cc:237] T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.834844 10022 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:15:59.688089  8250 raft_consensus.cc:1275] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer b3421ee20b674b879e0633e39c5709d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:16:00.102111  8250 pending_rounds.cc:85] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Aborting all ops after (but not including) 1
I20260709 12:16:00.102560  8250 pending_rounds.cc:107] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:16:00.102896  8250 raft_consensus.cc:2889] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:00.104225  8250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 254) took 1018 ms. Trace:
I20260709 12:16:00.104619 10022 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:15:59.798272  9961 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:15:59.752254  9916 raft_consensus.cc:515] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.119423  8251 raft_consensus.cc:1240] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:00.120031  8249 raft_consensus.cc:2368] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 6. Current term is 7.
I20260709 12:16:00.120313  8327 raft_consensus.cc:1275] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:00.122187  9916 leader_election.cc:290] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:15:59.821275  9937 raft_consensus.cc:515] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:16:00.124109  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.125059  9706 raft_consensus.cc:515] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:16:00.126439  8202 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:00.126216  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:15:59.926137  9913 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.128219  9706 leader_election.cc:290] T d75f6416846c431394d73267f34045a3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.129211  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:16:00.129575  9921 leader_election.cc:290] T d72e932c2eee4dd28f7f05aa582fcfb0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.129798  9647 leader_election.cc:290] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:16:00.009276  8369 leader_election.cc:304] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:16:00.026922  8256 raft_consensus.cc:2889] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:00.131618  9952 consensus_queue.cc:260] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:16:00.132594  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 242258us
I20260709 12:16:00.133878  9952 raft_consensus.cc:3060] T 6f757a1a65af43d8b4c8996f392e3bfd P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.044767  8330 raft_consensus.cc:2468] T 190df87128654922bd7944b9cbb1ae3b P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 7.
I20260709 12:16:00.075520  9727 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.077060  9586 leader_election.cc:290] T 305168f939834ee1886baf53318790a2 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.135447  9727 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.137449  9903 raft_consensus.cc:2749] T f19131ff5ec0499b93e228a1447e9a76 P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:00.139189  9969 raft_consensus.cc:3060] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:00.139942  9727 leader_election.cc:290] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:16:00.141182  8475 raft_consensus.cc:1240] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 35617b9c10ad4daa80878f0de881422c [term 3 LEADER]: Rejecting Update request from peer 29d436e9d3d54fe599d9aa67d38fba03 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:16:00.116912  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 128508us
I20260709 12:15:59.833982  9951 raft_consensus.cc:515] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.154031  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32666a4a15904513a3c010c3fa185950" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.155023  8406 raft_consensus.cc:2468] T 32666a4a15904513a3c010c3fa185950 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:16:00.106276  8222 leader_election.cc:304] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
W20260709 12:16:00.114634  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 46525.6us
I20260709 12:16:00.134758  8369 leader_election.cc:304] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70ae764f2abd44229023295f5cc6bf37, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:16:00.064255  9707 raft_consensus.cc:2749] T ea8792e9c5a048e987bab09333071e2e P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:00.104800  8250 rpcz_store.cc:276] 0709 12:15:59.085533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.622709 (+537176us) service_pool.cc:224] Handling call
0709 12:15:59.626617 (+  3908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.103752 (+477135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.104133 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.126255  9937 leader_election.cc:290] T 6aec989e68ad45a3b8540a35920b4b4e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.154716  9951 leader_election.cc:290] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.151268  9647 raft_consensus.cc:493] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:00.169878  8298 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.34.193:41731 timed out after 1.743s (SENT) [suppressed 12 similar messages]
W20260709 12:16:00.178733  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 105546us
I20260709 12:16:00.180110  8253 raft_consensus.cc:1240] T d66cbe0fda224c11a64b3afe9df50f1e P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 LEADER]: Rejecting Update request from peer b3421ee20b674b879e0633e39c5709d7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:00.181191  9704 raft_consensus.cc:2804] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:00.181803  9704 raft_consensus.cc:697] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [term 6 LEADER]: Becoming Leader. State: Replica: b3421ee20b674b879e0633e39c5709d7, State: Running, Role: LEADER
I20260709 12:16:00.183112  9704 consensus_queue.cc:237] T 6ab2c9e336d64e36988aa8af9b916076 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.184640  9748 raft_consensus.cc:3060] T 028c831fc6fe4bc3a5dacb16c136884b P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.186866  8250 raft_consensus.cc:1275] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Refusing update from remote peer 35617b9c10ad4daa80878f0de881422c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:00.176923  9707 consensus_queue.cc:1059] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 12:16:00.213461  9902 consensus_meta.cc:287] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37: Time spent flushing consensus metadata: real 1.061s	user 0.013s	sys 0.012s
I20260709 12:16:00.214147  9902 raft_consensus.cc:2749] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:00.215198  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:16:00.215036  9647 raft_consensus.cc:515] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.216085  8403 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:00.191159  9707 raft_consensus.cc:3055] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:16:00.222136  8298 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 52284.7us
I20260709 12:16:00.228415  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72e932c2eee4dd28f7f05aa582fcfb0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:16:00.220618  9707 raft_consensus.cc:740] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:16:00.231057  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.225898  9899 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:16:00.232108  8402 raft_consensus.cc:2410] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d436e9d3d54fe599d9aa67d38fba03 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:16:00.232182  9707 consensus_queue.cc:260] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.220191  9647 leader_election.cc:290] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.233870  9707 raft_consensus.cc:3060] T d488d21a9387402aa540f068f237a295 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:00.235963  9961 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
W20260709 12:16:00.237329  9646 consensus_meta.cc:287] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.006s
I20260709 12:16:00.239372  8251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 355) took 1063 ms. Trace:
I20260709 12:16:00.239827  8251 rpcz_store.cc:276] 0709 12:15:59.176131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.688498 (+512367us) service_pool.cc:224] Handling call
0709 12:15:59.688943 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.120043 (+431100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.239013 (+118970us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540026af54. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:16:00.239295 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985892608}
I20260709 12:16:00.244457  9899 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:16:00.248183  8253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 256) took 1162 ms. Trace:
W20260709 12:16:00.248607  8298 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.248708  8253 rpcz_store.cc:276] 0709 12:15:59.086092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.625500 (+539408us) service_pool.cc:224] Handling call
0709 12:15:59.625818 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.180758 (+554940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.247843 (+ 67085us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54009a7754. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:16:00.248110 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265627392}
I20260709 12:16:00.237843  9646 raft_consensus.cc:515] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
W20260709 12:16:00.224408  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 48552.2us
W20260709 12:16:00.248240  9751 consensus_meta.cc:287] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03: Time spent flushing consensus metadata: real 0.700s	user 0.017s	sys 0.003s
I20260709 12:16:00.252267 10022 raft_consensus.cc:2804] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:16:00.262655  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 43578.5us
I20260709 12:16:00.265313 10022 raft_consensus.cc:697] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:16:00.271929  8443 leader_election.cc:304] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:16:00.276017  8403 raft_consensus.cc:2468] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d436e9d3d54fe599d9aa67d38fba03 in term 5.
    @     0x7f12546bda9e kudu::TestWorkload::Setup() at ??:0
W20260709 12:16:00.273211 10008 log.cc:927] Time spent T 3d8f3d635a3b46938c2710e672edf79d P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.855s	user 0.004s	sys 0.001s
I20260709 12:16:00.280515  9681 raft_consensus.cc:515] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:16:00.281976  8323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58524 (request call id 279) took 1319 ms. Trace:
I20260709 12:16:00.282511  8332 raft_consensus.cc:2393] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:16:00.282464  8323 rpcz_store.cc:276] 0709 12:15:58.962140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.963579 (+  1439us) service_pool.cc:224] Handling call
0709 12:15:58.963882 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.968608 (+  4726us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:15:58.968903 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 12:15:59.220742 (+251839us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:59.227461 (+  6719us) log.cc:844] Serialized 26 byte log entry
0709 12:15:59.227608 (+   147us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:15:59.227645 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.227708 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:00.166246 (+938538us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:16:00.281376 (+115130us) raft_consensus.cc:1685] finished
0709 12:16:00.281519 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.281749 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4363,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":5244,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":9909,"spinlock_wait_cycles":59979136,"thread_start_us":251409,"threads_started":1,"wal-append.queue_time_us":375270}
W20260709 12:16:00.289285 10034 log.cc:927] Time spent T f19131ff5ec0499b93e228a1447e9a76 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:16:00.299489  8254 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 263) took 1113 ms. Trace:
I20260709 12:16:00.316622  9748 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.304344  8221 leader_election.cc:304] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:16:00.303393  8222 leader_election.cc:304] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, b3421ee20b674b879e0633e39c5709d7; no voters: 
I20260709 12:16:00.305729  9646 leader_election.cc:290] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:16:00.307489 10022 consensus_queue.cc:237] T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:16:00.308715  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
    @           0x35fb88 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:112
W20260709 12:16:00.320042  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 45041.5us
W20260709 12:16:00.309609  8220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.019s	sys 0.007s
I20260709 12:16:00.310942  8477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42020 (request call id 243) took 1071 ms. Trace:
I20260709 12:16:00.288308  9918 raft_consensus.cc:493] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.296757  8255 raft_consensus.cc:2393] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 6: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:16:00.267793  9753 raft_consensus.cc:493] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.312438  8252 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34266 (request call id 246) took 2171 ms. Trace:
I20260709 12:16:00.314383  9903 consensus_queue.cc:1048] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:00.263423  9751 raft_consensus.cc:515] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:16:00.323418  8220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.020s	sys 0.008s
    @           0x358216 kudu::master::LeaderRebalancerTest_RestartTserver_Test::TestBody() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:?
I20260709 12:16:00.327262  9834 raft_consensus.cc:2749] T ab17d74d3fe844ee9def403591842530 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:00.317586  9748 raft_consensus.cc:515] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:16:00.321125  8477 rpcz_store.cc:276] 0709 12:15:59.238916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.241034 (+  2118us) service_pool.cc:224] Handling call
0709 12:16:00.310437 (+1069403us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54008c9954. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.310710 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44811520}
I20260709 12:16:00.335090  8257 raft_consensus.cc:1240] T 31de02a86b3d49d1af63827598c1a76a P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:00.336464  8222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.195:41245, user_credentials={real_user=slave}} blocked reactor thread for 49668.2us
W20260709 12:16:00.341411  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 75367us
I20260709 12:16:00.344980  9753 raft_consensus.cc:515] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
W20260709 12:16:00.335088  8220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 768504us
I20260709 12:16:00.349320  9906 consensus_queue.cc:1059] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:00.349788  9681 leader_election.cc:290] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 election: Requested vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.338347  9899 raft_consensus.cc:2749] T cff9ab56f09c438293e24be61ae38fb3 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:00.351305  9899 consensus_queue.cc:1059] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:00.351747  9972 raft_consensus.cc:3055] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:00.321715  9918 raft_consensus.cc:515] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.352308  9899 raft_consensus.cc:3055] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:16:00.352777  9899 raft_consensus.cc:740] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
I20260709 12:16:00.352130  9646 raft_consensus.cc:2804] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:00.353451  9646 raft_consensus.cc:697] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:16:00.353943  9899 consensus_queue.cc:260] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
I20260709 12:16:00.352197  9972 raft_consensus.cc:740] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:16:00.355614  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ee06e6e6314c8f9f8c9ccfe13589a0" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:16:00.356149  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 52214.4us
I20260709 12:16:00.356091  9972 consensus_queue.cc:260] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.357671  8478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42030 (request call id 375) took 1108 ms. Trace:
I20260709 12:16:00.358075  8257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 362) took 1097 ms. Trace:
I20260709 12:16:00.360945  8256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34280 (request call id 360) took 1166 ms. Trace:
I20260709 12:16:00.361431  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a74bd0d6094fc497a5fd124956f81b" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:16:00.362332  8251 raft_consensus.cc:3060] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:00.361456  8256 rpcz_store.cc:276] 0709 12:15:59.194447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.132469 (+938022us) service_pool.cc:224] Handling call
0709 12:16:00.133030 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:00.133734 (+   704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.133783 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:00.134493 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:16:00.268265 (+133772us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:00.268328 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.268422 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:00.360684 (+ 92262us) raft_consensus.cc:1685] finished
0709 12:16:00.360712 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.360872 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1974,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":133151,"threads_started":1,"wal-append.queue_time_us":198487}
I20260709 12:16:00.363523  8479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42020 (request call id 245) took 1123 ms. Trace:
I20260709 12:16:00.317060  8254 rpcz_store.cc:276] 0709 12:15:59.185741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.122345 (+936604us) service_pool.cc:224] Handling call
0709 12:16:00.122975 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.123620 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:16:00.124148 (+   528us) log.cc:844] Serialized 14 byte log entry
0709 12:16:00.264855 (+140707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.266589 (+  1734us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:00.270359 (+  3770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.272781 (+  2422us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.299393 (+ 26612us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3578,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":4736,"spinlock_wait_cycles":6914432,"thread_start_us":130279,"threads_started":1}
I20260709 12:16:00.363940  8479 rpcz_store.cc:276] 0709 12:15:59.239723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.245616 (+  5893us) service_pool.cc:224] Handling call
0709 12:15:59.245968 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:59.260345 (+ 14377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:59.260391 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:59.270610 (+ 10219us) log.cc:844] Serialized 52 byte log entry
0709 12:16:00.152817 (+882207us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18000364c0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f1253ec8ab1 00007f1253ed5281 00007f124afe2e07 00007f1253e3d9a9 00007f124afff69b 00007f124affd93f 00007f124afffc02 00007f124dc8720b 00007f124dc8cd23 00007f124dc8d0d1 00007f124e0a8a0f
0709 12:16:00.273343 (+120526us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:16:00.273388 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.319920 (+ 46532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:00.363079 (+ 43159us) raft_consensus.cc:1685] finished
0709 12:16:00.363104 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.363339 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13913,"raft.queue_time_us":14865,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9095,"spinlock_wait_cycles":10462464,"thread_start_us":115523,"threads_started":1,"wal-append.queue_time_us":1036902}
I20260709 12:16:00.354530  9646 consensus_queue.cc:237] T 2d6df51ca3f54a65a96f425ead4beeb7 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.367983  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d488d21a9387402aa540f068f237a295" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:16:00.357699  9756 raft_consensus.cc:2749] T 438aca5a484b480e8aa3600500c15d5f P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:00.369517  8476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42030 (request call id 376) took 1120 ms. Trace:
I20260709 12:16:00.369976  8476 rpcz_store.cc:276] 0709 12:15:59.248852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.307884 (+ 59032us) service_pool.cc:224] Handling call
0709 12:16:00.369134 (+1061250us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400134554. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.369320 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889851648}
I20260709 12:16:00.357969  9972 raft_consensus.cc:3060] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:00.371161  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "000cbbc93f224c7abbc8fc7d61b4e191" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:16:00.372663  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75f6416846c431394d73267f34045a3" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:16:00.372992  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37"
W20260709 12:16:00.373858 10039 log.cc:927] Time spent T 28b049654a98498cb575cc50eb45a7f9 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:16:00.373019  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:16:00.374910  8323 raft_consensus.cc:2468] T dec01fc5fb0a43e6808551ad72c5d606 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:16:00.373958  8329 raft_consensus.cc:2393] T 416f9094abe24cb79ae383453f8b221e P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 5: Already voted for candidate 70ae764f2abd44229023295f5cc6bf37 in this term.
I20260709 12:16:00.376933  8405 raft_consensus.cc:1240] T 7f44f2df1a8f4503828d8b04a53f6b95 P b3421ee20b674b879e0633e39c5709d7 [term 7 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 6. Current term is 7. Ops: []
I20260709 12:16:00.378403  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:16:00.379252  8328 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 5.
I20260709 12:16:00.379096  9651 raft_consensus.cc:515] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.381587  9651 leader_election.cc:290] T cff9ab56f09c438293e24be61ae38fb3 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.382519  8249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34270 (request call id 281) took 1269 ms. Trace:
I20260709 12:16:00.383042  8249 rpcz_store.cc:276] 0709 12:15:59.112781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.596303 (+483522us) service_pool.cc:224] Handling call
0709 12:16:00.382237 (+785934us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540048bcd4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.382450 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114267904}
I20260709 12:16:00.322552  8252 rpcz_store.cc:276] 0709 12:15:58.140993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:58.740350 (+599357us) service_pool.cc:224] Handling call
0709 12:15:58.741020 (+   670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:58.784266 (+ 43246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:58.784297 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:58.784742 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:15:58.853080 (+ 68338us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:15:58.853133 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:59.560039 (+706906us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124ae88db1 00007f124af26c85 00007f124af276a2 00007f124dc991db 00007f124dc94aaf 00007f124dc8886e 00007f124dc87bb6 00007f124dc877d8 00007f124dc91221 00007f124dc911d9 00007f124dc91169
0709 12:16:00.311675 (+751636us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b5400517054. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ede01 00007f124e0ec83e 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6
0709 12:16:00.311796 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:00.311909 (+   113us) raft_consensus.cc:1685] finished
0709 12:16:00.311927 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.312192 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468,"raft.queue_time_us":1166,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":1709,"spinlock_wait_cycles":101048960,"thread_start_us":47626,"threads_started":1,"wal-append.queue_time_us":138881}
I20260709 12:16:00.384519  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305168f939834ee1886baf53318790a2" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "70ae764f2abd44229023295f5cc6bf37" is_pre_election: true
I20260709 12:16:00.385327  8330 raft_consensus.cc:2468] T 305168f939834ee1886baf53318790a2 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 4.
I20260709 12:16:00.358266  8478 rpcz_store.cc:276] 0709 12:15:59.248636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.594148 (+345512us) service_pool.cc:224] Handling call
0709 12:16:00.314617 (+720469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.314922 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:00.314947 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:00.315024 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:00.315061 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.316482 (+  1421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:00.357236 (+ 40754us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54008c9950. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.357453 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655900416}
I20260709 12:16:00.354712  9918 leader_election.cc:290] T 300320f772ad478099f8979d4543de23 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.393482  9751 leader_election.cc:290] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 4 election: Requested vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.395561  8221 leader_election.cc:304] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03; no voters: 35617b9c10ad4daa80878f0de881422c, b3421ee20b674b879e0633e39c5709d7
I20260709 12:16:00.333016  9903 consensus_queue.cc:1243] T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer 35617b9c10ad4daa80878f0de881422c log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:16:00.397174  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 61182.6us
I20260709 12:16:00.398415  8255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34280 (request call id 361) took 1203 ms. Trace:
I20260709 12:16:00.391754  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab2c9e336d64e36988aa8af9b916076" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.373660  8324 raft_consensus.cc:2468] T d75f6416846c431394d73267f34045a3 P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35617b9c10ad4daa80878f0de881422c in term 6.
I20260709 12:16:00.358481  8257 rpcz_store.cc:276] 0709 12:15:59.260367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:00.179478 (+919111us) service_pool.cc:224] Handling call
0709 12:16:00.218388 (+ 38910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.337983 (+119595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.358017 (+ 20034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:00.398873  8255 rpcz_store.cc:276] 0709 12:15:59.194702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.430104 (+235402us) service_pool.cc:224] Handling call
0709 12:16:00.398159 (+968055us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540048add4. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0f12fa 00007f12530b2b17 00007f124c62d6d4 00007f124c62d662 00007f124c62d591 00007f124c62d50c 00007f124c62c7c2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.398354 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655433600}
I20260709 12:16:00.405665  8253 raft_consensus.cc:2393] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 5: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:16:00.412247  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "300320f772ad478099f8979d4543de23" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.415481  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde30635c7f45dead7584c98d2d807d" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:16:00.415851  8250 raft_consensus.cc:2468] T 000cbbc93f224c7abbc8fc7d61b4e191 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:16:00.416808  8248 raft_consensus.cc:1240] T ae4f4f07bd32437a98ac789ece17a21b P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Rejecting Update request from peer 70ae764f2abd44229023295f5cc6bf37 for earlier term 5. Current term is 6. Ops: []
I20260709 12:16:00.417937  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7"
I20260709 12:16:00.418781  8405 raft_consensus.cc:2368] T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 4. Current term is 5.
I20260709 12:16:00.419391  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:16:00.419606  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:16:00.420090  8474 raft_consensus.cc:2468] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:16:00.400978  9753 leader_election.cc:290] T 3344c86d5a404f19a609fac8030806a9 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.429385  9751 raft_consensus.cc:2749] T 61fe6595501f4c619d61dedd4c8eb8b5 P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:00.430351  8295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:00.430260  8223 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.437585  8297 leader_election.cc:400] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Vote denied by peer b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245) with higher term. Message: Invalid argument: T 2d6df51ca3f54a65a96f425ead4beeb7 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 for earlier term 4. Current term is 5.
I20260709 12:16:00.438133  8297 leader_election.cc:403] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:16:00.439383  8405 raft_consensus.cc:1275] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Refusing update from remote peer 70ae764f2abd44229023295f5cc6bf37: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:00.439596  8256 raft_consensus.cc:2393] T 6ab2c9e336d64e36988aa8af9b916076 P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70ae764f2abd44229023295f5cc6bf37 in current term 6: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:16:00.443264  8251 raft_consensus.cc:2468] T f7a74bd0d6094fc497a5fd124956f81b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 5.
I20260709 12:16:00.430444  9751 raft_consensus.cc:493] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.442365  9651 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
W20260709 12:16:00.455456  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 135335us
I20260709 12:16:00.456382  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
W20260709 12:16:00.457532  8222 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.453563  8443 leader_election.cc:304] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:16:00.447952  9899 raft_consensus.cc:3060] T 7f44f2df1a8f4503828d8b04a53f6b95 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:16:00.459928  8474 raft_consensus.cc:2468] T 32248472abc44c9bba02ee8e40ec7475 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:16:00.455528  9701 raft_consensus.cc:493] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.463184  9969 consensus_queue.cc:1048] T 47ee06e6e6314c8f9f8c9ccfe13589a0 P 70ae764f2abd44229023295f5cc6bf37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:16:00.470326  8370 leader_election.cc:304] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:16:00.455747  9651 raft_consensus.cc:515] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.476608  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42ccdb3fbee4edcb15e2a892b920759" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.449537  9647 raft_consensus.cc:493] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.478559  8252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190df87128654922bd7944b9cbb1ae3b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
I20260709 12:16:00.481115  8251 raft_consensus.cc:1240] T 0fde30635c7f45dead7584c98d2d807d P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Rejecting Update request from peer 35617b9c10ad4daa80878f0de881422c for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:00.485905  9701 raft_consensus.cc:515] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.488278  9903 consensus_queue.cc:1048] T 9e104b0cfb404501a9910825b4ee355c P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:00.489711  9701 leader_election.cc:290] T 28270200f56944ca899873c119f8ae9b P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.490477  9903 raft_consensus.cc:2749] T 6aec989e68ad45a3b8540a35920b4b4e P b3421ee20b674b879e0633e39c5709d7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:16:00.492892  8252 raft_consensus.cc:2393] T 190df87128654922bd7944b9cbb1ae3b P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 35617b9c10ad4daa80878f0de881422c in current term 7: Already voted for candidate 29d436e9d3d54fe599d9aa67d38fba03 in this term.
I20260709 12:16:00.464232  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb3616518e54d0295c345f3153cf62b" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.498301  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28270200f56944ca899873c119f8ae9b" candidate_uuid: "29d436e9d3d54fe599d9aa67d38fba03" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.482491  9834 raft_consensus.cc:2804] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:00.501528  9966 raft_consensus.cc:3060] T 2d6df51ca3f54a65a96f425ead4beeb7 P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:00.503774 10044 log.cc:927] Time spent T bbb3616518e54d0295c345f3153cf62b P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:16:00.504792  8221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 109446us
I20260709 12:16:00.505787  8221 leader_election.cc:304] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c; no voters: b3421ee20b674b879e0633e39c5709d7
I20260709 12:16:00.506879  9952 raft_consensus.cc:2804] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:16:00.507566  9952 raft_consensus.cc:697] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [term 7 LEADER]: Becoming Leader. State: Replica: 29d436e9d3d54fe599d9aa67d38fba03, State: Running, Role: LEADER
I20260709 12:16:00.508713  9952 consensus_queue.cc:237] T 9e104b0cfb404501a9910825b4ee355c P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:16:00.480041  9751 raft_consensus.cc:515] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.511526  9751 leader_election.cc:290] T 5925c1429975480998dca9d5db37b825 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 70ae764f2abd44229023295f5cc6bf37 (127.3.34.194:39513)
I20260709 12:16:00.491168  8446 leader_election.cc:304] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 70ae764f2abd44229023295f5cc6bf37
I20260709 12:16:00.513269  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6aec989e68ad45a3b8540a35920b4b4e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.521664  9951 raft_consensus.cc:493] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:16:00.525110  8296 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:16:00.526813  9913 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:00.527386  9651 leader_election.cc:290] T fd5832a7f1874b879d2943248a7135fe P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731), b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245)
I20260709 12:16:00.527278  9913 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:16:00.528115  9913 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:00.531102  8250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416f9094abe24cb79ae383453f8b221e" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:16:00.532670  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 53875.5us
I20260709 12:16:00.544837  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5832a7f1874b879d2943248a7135fe" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.522572  9951 raft_consensus.cc:515] T f19131ff5ec0499b93e228a1447e9a76 P 70ae764f2abd44229023295f5cc6bf37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
I20260709 12:16:00.549852  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da618d8bd7a4d3dbf914c3a6af98081" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.531890  8250 raft_consensus.cc:3060] T 416f9094abe24cb79ae383453f8b221e P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:00.567324  8248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34270 (request call id 287) took 1423 ms. Trace:
I20260709 12:16:00.574440  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.527195  9902 raft_consensus.cc:493] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.578596  8257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc19f18db497464596bb5dba990be7ce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.568243  8248 rpcz_store.cc:276] 0709 12:15:59.130979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:59.667801 (+536822us) service_pool.cc:224] Handling call
0709 12:16:00.405320 (+737519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:00.417408 (+ 12088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:00.542113 (+124705us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540048add0. stack: 00007f124afce343 00007f124afce240 00007f124a95d1d4 00007f125469b304 00007f125469b299 00007f124e056571 00007f124e0ec8ad 00007f12530b1419 00007f124c628bd4 00007f124c628b62 00007f124c628a91 00007f124c628a0c 00007f124c627cc2 00007f124c42848c 00007f124c4278c6 00007f124c42726f
0709 12:16:00.553542 (+ 11429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636351232}
I20260709 12:16:00.535117  9834 raft_consensus.cc:697] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [term 7 LEADER]: Becoming Leader. State: Replica: 35617b9c10ad4daa80878f0de881422c, State: Running, Role: LEADER
W20260709 12:16:00.593503  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 194173us
W20260709 12:16:00.610741  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 138723us
W20260709 12:16:00.616932  8446 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 184108us
I20260709 12:16:00.625120  8257 raft_consensus.cc:2468] T cc19f18db497464596bb5dba990be7ce P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 4.
I20260709 12:16:00.609273  9748 leader_election.cc:290] T e42ccdb3fbee4edcb15e2a892b920759 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.618630  8254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec01fc5fb0a43e6808551ad72c5d606" candidate_uuid: "35617b9c10ad4daa80878f0de881422c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.647738  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e17a45545cc34a9ca0576c94ee626ccc" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
W20260709 12:16:00.659175  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.194:39513, user_credentials={real_user=slave}} blocked reactor thread for 98071.1us
I20260709 12:16:00.660041  8443 leader_election.cc:304] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:16:00.653865  9748 raft_consensus.cc:493] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.661185  8443 leader_election.cc:304] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35617b9c10ad4daa80878f0de881422c, 70ae764f2abd44229023295f5cc6bf37; no voters: 
I20260709 12:16:00.662331  9937 raft_consensus.cc:2804] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:00.662838  9937 raft_consensus.cc:493] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:00.663321  9937 raft_consensus.cc:3060] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:00.667223  9791 raft_consensus.cc:493] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.667549  9961 raft_consensus.cc:2804] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:00.668041  9961 raft_consensus.cc:493] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:16:00.667968  9791 raft_consensus.cc:515] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:16:00.668596  9961 raft_consensus.cc:3060] T e17a45545cc34a9ca0576c94ee626ccc P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:16:00.660053  8372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.193:41731, user_credentials={real_user=slave}} blocked reactor thread for 154302us
I20260709 12:16:00.671113  9885 raft_consensus.cc:2749] T 9dbab756712a45979451545f2bc323f1 P 35617b9c10ad4daa80878f0de881422c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:00.580329  9903 consensus_queue.cc:1048] T 3d8f3d635a3b46938c2710e672edf79d P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:16:00.670696  8251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f7d306897264222a2d589b45d592dce" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.637338  9902 raft_consensus.cc:515] T aebbe34acf2b4c6dbeb80e89dd1d5fc9 P 70ae764f2abd44229023295f5cc6bf37 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } }
W20260709 12:16:00.686133 10052 log.cc:927] Time spent T faea1550226d4b32b5e0955096972f73 P 29d436e9d3d54fe599d9aa67d38fba03: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:16:00.579250  9647 raft_consensus.cc:515] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } } peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } }
I20260709 12:16:00.670702  9791 leader_election.cc:290] T 830be490ae644f67b4bf87248e3bb615 P 35617b9c10ad4daa80878f0de881422c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.652446  8370 leader_election.cc:304] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3421ee20b674b879e0633e39c5709d7; no voters: 29d436e9d3d54fe599d9aa67d38fba03, 35617b9c10ad4daa80878f0de881422c
I20260709 12:16:00.661741  9748 raft_consensus.cc:515] T 53cf6c47fc2b43f69bbc266d55353c9a P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } } peers { permanent_uuid: "b3421ee20b674b879e0633e39c5709d7" member_type: VOTER last_known_addr { host: "127.3.34.195" port: 41245 } }
W20260709 12:16:00.701280  8444 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:00.719074  9834 consensus_queue.cc:237] T 190df87128654922bd7944b9cbb1ae3b P 35617b9c10ad4daa80878f0de881422c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.700686  8251 raft_consensus.cc:2468] T 2f7d306897264222a2d589b45d592dce P 29d436e9d3d54fe599d9aa67d38fba03 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 6.
I20260709 12:16:00.701195  9751 raft_consensus.cc:493] T fd5832a7f1874b879d2943248a7135fe P 29d436e9d3d54fe599d9aa67d38fba03 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.721129  9651 raft_consensus.cc:493] T 1928b0c529924067acf1990936762a6e P 70ae764f2abd44229023295f5cc6bf37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b3421ee20b674b879e0633e39c5709d7)
I20260709 12:16:00.690735  9885 raft_consensus.cc:493] T e42ccdb3fbee4edcb15e2a892b920759 P 35617b9c10ad4daa80878f0de881422c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.720299  9952 consensus_queue.cc:1048] T 6da618d8bd7a4d3dbf914c3a6af98081 P 29d436e9d3d54fe599d9aa67d38fba03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:00.732611  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f44f2df1a8f4503828d8b04a53f6b95" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c"
W20260709 12:16:00.747555 10056 log.cc:927] Time spent T 5925c1429975480998dca9d5db37b825 P 70ae764f2abd44229023295f5cc6bf37: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:16:00.700577  9969 raft_consensus.cc:493] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 29d436e9d3d54fe599d9aa67d38fba03)
I20260709 12:16:00.752348  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed8246ac7e249fdae8fe1c01cba50f3" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:16:00.752070  9913 raft_consensus.cc:515] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
I20260709 12:16:00.756450  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fe6595501f4c619d61dedd4c8eb8b5" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:16:00.756618  8256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6df51ca3f54a65a96f425ead4beeb7" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03"
W20260709 12:16:00.752609 10050 log.cc:927] Time spent T e42ccdb3fbee4edcb15e2a892b920759 P b3421ee20b674b879e0633e39c5709d7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:16:00.737844  9704 raft_consensus.cc:2749] T d72e932c2eee4dd28f7f05aa582fcfb0 P b3421ee20b674b879e0633e39c5709d7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:00.733036  8253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2165d3c7a64aecb05f5e7a9223ecd8" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "29d436e9d3d54fe599d9aa67d38fba03" is_pre_election: true
I20260709 12:16:00.766620 10062 raft_consensus.cc:493] T bedb2c9a19ab4ffbac05001cfcb9bf84 P b3421ee20b674b879e0633e39c5709d7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:00.771921  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32248472abc44c9bba02ee8e40ec7475" candidate_uuid: "b3421ee20b674b879e0633e39c5709d7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35617b9c10ad4daa80878f0de881422c" is_pre_election: true
I20260709 12:16:00.773574  8406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19131ff5ec0499b93e228a1447e9a76" candidate_uuid: "70ae764f2abd44229023295f5cc6bf37" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b3421ee20b674b879e0633e39c5709d7" is_pre_election: true
I20260709 12:16:00.774279  8403 raft_consensus.cc:1275] T 31de02a86b3d49d1af63827598c1a76a P b3421ee20b674b879e0633e39c5709d7 [term 3 FOLLOWER]: Refusing update from remote peer 29d436e9d3d54fe599d9aa67d38fba03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:16:00.770027  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.34.196:42085, user_credentials={real_user=slave}} blocked reactor thread for 130955us
I20260709 12:16:00.769304  8253 raft_consensus.cc:2468] T cb2165d3c7a64aecb05f5e7a9223ecd8 P 29d436e9d3d54fe599d9aa67d38fba03 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70ae764f2abd44229023295f5cc6bf37 in term 3.
I20260709 12:16:00.776885  9647 leader_election.cc:290] T af028603c5e74d4c8e598da3c03999d8 P 29d436e9d3d54fe599d9aa67d38fba03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b3421ee20b674b879e0633e39c5709d7 (127.3.34.195:41245), 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085)
I20260709 12:16:00.777127 10059 consensus_queue.cc:1059] T d66cbe0fda224c11a64b3afe9df50f1e P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:00.769804  9903 consensus_queue.cc:1059] T f7a74bd0d6094fc497a5fd124956f81b P b3421ee20b674b879e0633e39c5709d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:00.780061  9969 raft_consensus.cc:515] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
    @     0x7f124b230e10 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260709 12:16:00.817322  9969 leader_election.cc:290] T 6da618d8bd7a4d3dbf914c3a6af98081 P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.784680  9913 leader_election.cc:290] T e17a45545cc34a9ca0576c94ee626ccc P 70ae764f2abd44229023295f5cc6bf37 [CANDIDATE]: Term 6 election: Requested vote from peers 35617b9c10ad4daa80878f0de881422c (127.3.34.196:42085), 29d436e9d3d54fe599d9aa67d38fba03 (127.3.34.193:41731)
I20260709 12:16:00.785317  9937 raft_consensus.cc:515] T dec01fc5fb0a43e6808551ad72c5d606 P 35617b9c10ad4daa80878f0de881422c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35617b9c10ad4daa80878f0de881422c" member_type: VOTER last_known_addr { host: "127.3.34.196" port: 42085 } } peers { permanent_uuid: "29d436e9d3d54fe599d9aa67d38fba03" member_type: VOTER last_known_addr { host: "127.3.34.193" port: 41731 } } peers { permanent_uuid: "70ae764f2abd44229023295f5cc6bf37" member_type: VOTER last_known_addr { host: "127.3.34.194" port: 39513 } }
    @     0x7f124b20ea12 testing::Test::Run() at ??:0
    @     0x7f124b20fd29 testing::TestInfo::Run() at ??:0
    @     0x7f124b210d05 testing::TestSuite::Run() at ??:0
    @     0x7f124b2257f5 testing::internal::UnitTestImpl::RunAllTests() at ??:0
    @     0x7f124b231cd0 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
    @     0x7f124b224dad testing::UnitTest::Run() at ??:0
    @           0x38839c RUN_ALL_TESTS() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
    @           0x386f9d main at /apache/dev/git/kudu/src/kudu/util/test_main.cc:?
    @     0x7f12478d6c87 __libc_start_main at ??:0
    @           0x29f0da _start at ??:?
